-- Logs begin at Mon 2022-09-12 13:33:55 UTC, end at Mon 2022-09-12 14:38:42 UTC. -- Sep 12 13:58:45.510052 dv-cinder-820027-25-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 12 13:58:45.519324 dv-cinder-820027-25-smb devstack@keystone.service[81599]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 13:58:45 2022] *** Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: nodename: dv-cinder-820027-25-smb Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: machine: x86_64 Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: clock source: unix Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: pcre jit disabled Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: detected number of CPU cores: 4 Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: current working directory: / Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: detected binary path: /usr/bin/uwsgi-core Sep 12 13:58:45.521319 dv-cinder-820027-25-smb devstack@keystone.service[81599]: your processes number limit is 47680 Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: your memory page size is 4096 bytes Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: detected max file descriptor number: 2048 Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: lock engine: pthread robust mutexes Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: thunder lock: enabled Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 12 13:58:45.522030 dv-cinder-820027-25-smb devstack@keystone.service[81599]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 13:58:45.562524 dv-cinder-820027-25-smb devstack@keystone.service[81599]: Python main interpreter initialized at 0x5644a37e99c0 Sep 12 13:58:45.562524 dv-cinder-820027-25-smb devstack@keystone.service[81599]: python threads support enabled Sep 12 13:58:45.562524 dv-cinder-820027-25-smb devstack@keystone.service[81599]: your server socket listen backlog is limited to 100 connections Sep 12 13:58:45.562524 dv-cinder-820027-25-smb devstack@keystone.service[81599]: your mercy for graceful operations on workers is 90 seconds Sep 12 13:58:45.562893 dv-cinder-820027-25-smb devstack@keystone.service[81599]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 13:58:45.562976 dv-cinder-820027-25-smb devstack@keystone.service[81599]: *** Operational MODE: preforking *** Sep 12 13:58:45.563234 dv-cinder-820027-25-smb devstack@keystone.service[81599]: *** uWSGI is running in multiple interpreter mode *** Sep 12 13:58:45.563234 dv-cinder-820027-25-smb devstack@keystone.service[81599]: spawned uWSGI master process (pid: 81599) Sep 12 13:58:45.563438 dv-cinder-820027-25-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 12 13:58:45.564499 dv-cinder-820027-25-smb devstack@keystone.service[81599]: spawned uWSGI worker 1 (pid: 81611, cores: 1) Sep 12 13:58:45.564499 dv-cinder-820027-25-smb devstack@keystone.service[81599]: spawned uWSGI worker 2 (pid: 81612, cores: 1) Sep 12 13:58:45.564499 dv-cinder-820027-25-smb devstack@keystone.service[81599]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 13:58:49.844860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 13:58:49.844860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Sep 12 13:58:49.845661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 13:58:49.845661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Sep 12 13:58:49.845661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 13:58:49.845661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Sep 12 13:58:49.846171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 13:58:49.846171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Sep 12 13:58:49.894976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 13:58:49.895189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 13:58:49.895288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 13:58:49.895379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] command line args: [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 13:58:49.895457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 13:58:49.895577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] command line args: [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 13:58:49.895655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 13:58:49.895798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ================================================================================ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 13:58:49.895877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 13:58:49.896012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ================================================================================ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 13:58:49.896096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_dir = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_dir = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_source = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] debug = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_source = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.896997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] debug = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.897963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_config_append = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_config_append = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_dir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.898988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_dir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.899952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.900916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.901996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.902929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] publish_errors = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] publish_errors = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.903882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] standard_threads = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] standard_threads = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.904995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.905595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.905714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.905828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_journal = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_journal = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_json = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_json = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_stderr = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_stderr = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_syslog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_syslog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.906959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 13:58:49.907087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.907925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.908880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.909921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.910979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.911888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.912948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.913950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.914981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.915954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.916989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.917795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.918953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.919914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.920645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.921902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.922969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.923938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.924953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.925960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.926992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.927938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.928953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.929891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.930956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.931960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.external = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.932932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.external = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.password = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.933886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.token = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.password = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.token = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.934945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.935912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.936977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.937918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.938967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.939949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.940905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.941964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.942909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.943943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.944886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.945930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.946998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.947969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.948919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.949964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.950901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.951860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.952901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.953950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.954891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.955905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956484 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.956966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.957916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.958975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959814 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.959930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.960985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.961917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.962970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.963992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.964923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.965924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.966963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.967091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.967221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.967339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.967455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.968927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.969913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.970966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.971918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972861 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.972976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.973910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.974969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.975973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.976917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.977974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.978919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.979910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.980959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.981893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.982951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 13:58:49.983116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 13:58:50.008984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.009215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.009440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.009643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.009877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.010105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.017618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.018347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.046439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.046634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.046720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.046863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.099619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.102038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.148004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.148237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.148792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.149030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.303969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.304893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.326901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.327639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.327735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.327873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.327956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.328941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.339684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.340068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.352761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.352958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.353982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.354066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.354198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.354411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.354625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 13:58:50.371064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.371280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 13:58:50.371487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.371619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.371701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 13:58:50.371818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 13:58:50.372020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 13:58:50.372333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.372850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.373008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.373261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.382592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.382873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.382957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.383167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.383250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.383434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.383516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.383713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.390925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.391192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.393851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.394085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.394169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.394368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.394451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.394647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.394741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.394926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.395825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.396808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.419715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.419927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.421209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.421405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.421489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.421687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.426147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.426338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.426423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.426621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.426714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.426930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.433065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.433228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.433353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.433514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.438947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.439084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.439284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.439367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.439575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.439671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.439866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.439949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.440954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.441035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.456833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.456927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.457110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.457195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.460957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.461061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.464205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.464298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.464499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.464582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.469284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.469378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.472451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.472541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.475655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.475753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.475951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.476871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.477069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.477166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.492928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.493095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.493213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.493379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.493487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.493646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.493751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.493906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.500562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.500783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.502069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.502320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.503599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.503876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.503959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.504159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.506564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.506830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.506913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.507815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.508112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.519477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.519767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.519850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.520046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.520980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.521071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.521260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.521344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.521538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.537163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.537427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.540096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.540356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.542982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.543240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.544476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.544687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.545952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.546191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.546274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.546472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.546630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.546864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.553018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.553246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.554456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.554688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.557349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.557579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.557746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.557968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.558051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.558254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.558418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.558532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.566612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.566857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.566989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.567173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.567257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.567454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.574068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.574280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 13:58:50.574365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.574563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.574646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.574844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.574939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.575978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.576883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.577802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.577890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.578050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.578141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.578364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.578446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.578634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 13:58:50.612838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644a37e99c0 pid: 81611 (default app) Sep 12 13:58:50.614606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644a37e99c0 pid: 81612 (default app) Sep 12 13:58:50.616176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f888b8a-8276-4631-b440-74c15e9b9cc9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:58:50.616467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f888b8a-8276-4631-b440-74c15e9b9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:58:50.616740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f888b8a-8276-4631-b440-74c15e9b9cc9 None None] PATH_INFO: `/v3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:58:50.620928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Sep 12 13:58:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:58:57.358391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:58:57.358885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:58:57.358989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:58:57.363511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:58:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 13:58:57.368754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:58:57.369204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:58:57.369349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:58:57.439798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: INFO dbcounter [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] Registered counter for database keystone Sep 12 13:58:57.458941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG oslo_db.sqlalchemy.engines [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 13:58:57.465070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writer thread running {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 13:58:57.639592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81611) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 13:58:57.639895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81611) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 13:58:57.698006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:58:57.699628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:58:57.826665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:58:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 13:58:58.262650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:58:58.336168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: INFO dbcounter [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] Registered counter for database keystone Sep 12 13:58:58.357090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG oslo_db.sqlalchemy.engines [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 13:58:58.363473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writer thread running {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 13:58:58.479265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72588-58ac-455a-8683-40e852d83b60 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:58:58.484027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:58:58.484643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:58:58.484920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:58:58.485188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:58:58.493492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:58:58.543589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 13:58:58.543930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfb789-2b4d-4e7f-8597-470554cc0687 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:58:58.553506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Sep 12 13:58:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 13:58:58.559544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:58:58.576648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813575b6-a686-4e78-81b7-e2c395a31be5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:58:58.581068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:58:58.582165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:58:58.582450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:58:58.582724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] PATH_INFO: `/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:58:58.584353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f81b8c04c00483f8fd1db4c83254d3d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:58:58.638832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING keystone.common.rbac_enforcer.enforcer [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 13:58:58.639142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1ec2c-d08f-4e29-9956-8b4da495d317 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:58:58.643657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Sep 12 13:58:58 2022] GET /identity/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:00.744700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14afc7-2330-46a8-9335-d1a24db50590 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:00.745269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14afc7-2330-46a8-9335-d1a24db50590 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:00.745269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14afc7-2330-46a8-9335-d1a24db50590 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:00.749978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:00.755580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:00.755960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:00.756125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:00.776131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:00.777670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:00.785777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 13:59:01.051180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14afc7-2330-46a8-9335-d1a24db50590 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:01.063013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14afc7-2330-46a8-9335-d1a24db50590 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:01.067241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:01.067834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:01.068113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:01.068384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:01.075820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:01.077597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb180a-59b7-4ab6-ad85-51eebd40a09f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:01.086057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Sep 12 13:59:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 13:59:01.091316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:01.100815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9aa8c-3925-42dd-8c20-76db7a9e56a9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:01.105172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:01.105804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:01.106090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:01.106365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:01.107742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:01.110250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751649b-b315-400e-85e4-160a705f334e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:01.111823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Sep 12 13:59:01 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:03.323006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bd1a-1c80-4208-b91a-062b6cd0fea1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.323578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bd1a-1c80-4208-b91a-062b6cd0fea1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.323578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bd1a-1c80-4208-b91a-062b6cd0fea1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.324945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:03.331526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf145-4a9a-446d-b026-f0c45348be4a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.332055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf145-4a9a-446d-b026-f0c45348be4a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.332055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf145-4a9a-446d-b026-f0c45348be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.350700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-582cf145-4a9a-446d-b026-f0c45348be4a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:03.351918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-582cf145-4a9a-446d-b026-f0c45348be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:03.431740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:03.434355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c7e-df0d-4eec-8d36-529fc2b0868a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.434637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c7e-df0d-4eec-8d36-529fc2b0868a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.434910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c7e-df0d-4eec-8d36-529fc2b0868a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.436751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 6/12] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:03.441908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.442200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.442477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.461716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:03.462907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:03.479005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:03.530926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:03.696466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e51c7e-df0d-4eec-8d36-529fc2b0868a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:03.799279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:03.836495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e51c7e-df0d-4eec-8d36-529fc2b0868a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:03.870061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:03.870910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.871218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.871490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.883155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:03.893479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:03.894571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:03.900147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:03.900998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:03.901081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f43c-03a2-48fd-9dde-017c703af007 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:03.933959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:03.934226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:03.934849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:03.935159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:03.935432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:03.957282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:04.002083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6298-dc97-4917-b07b-c11c3ca7bb83 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.004565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.006048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.034769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.035421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.035705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.035986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.036660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:04.036965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.038354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.050410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:04.055988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:04.101209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:04.106816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:04.152603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:04.159692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d695-d3cf-4c85-9668-6d6395e09c01 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.160483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:04.193567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.194198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.194481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.194759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.196364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.197825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.199437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:04 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:04.204714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:04.208372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b247ac-bf46-4db8-940c-c07e1538e61e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.242532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.243199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.243477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.243747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.254951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.256445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 13:59:04.274298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:04.275387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 13:59:04.276197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 13:59:04.276197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 13:59:04.276197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:04.276197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:04.281228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:04.303882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920541b8-e81c-4b58-a393-4489a58f8807 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.341372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.342423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.342423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.342680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.343749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.345199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.346758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:04.352449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:04.383585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:04.384631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820750-62f4-4e9a-9c9a-b414ef2e2eb5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.387324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:04.418828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.419466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.419749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.420024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.421213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:04.421516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.422912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f809-c849-46a1-b4b1-5835338e1016 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.440157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 13:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:04.454183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959df3d-13b5-40a5-9426-da78ba7b2a8b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:04.489898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:04.490525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:04.490803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:04.491117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:04.491877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.domain.id=default, user.id=4690e95140304ab282894ee992a544f2) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:04.492185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:04.493695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c2ef-5265-4dce-8421-17093a24f3bb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:04.503984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Sep 12 13:59:04 2022] GET /identity/v3/role_assignments?user.id=4690e95140304ab282894ee992a544f2&scope.domain.id=default&role.id=c0a540da48234e2db9dc1b474267f52f => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:06.943119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8286e-97ec-4856-bdce-cf0922e1dece None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:06.943638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8286e-97ec-4856-bdce-cf0922e1dece None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:06.943742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8286e-97ec-4856-bdce-cf0922e1dece None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:06.945494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:06.951190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:06.952253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:06.952468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:06.975599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81612) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 13:59:06.975991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81612) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 13:59:07.040150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:07.041964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-11f6f664-3f11-4b42-b543-537c4db1c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:07.085712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3b8f-04c0-46c7-8759-5d4d3ff6f411 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.086021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3b8f-04c0-46c7-8759-5d4d3ff6f411 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.086282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3b8f-04c0-46c7-8759-5d4d3ff6f411 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.087650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:07.094407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.094693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.094972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.131933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:07.133169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:07.174242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:07.179254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d452-0907-40c3-a2bb-3efba3dbcf8b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.179544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d452-0907-40c3-a2bb-3efba3dbcf8b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.179820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d452-0907-40c3-a2bb-3efba3dbcf8b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.181112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:07.193431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.193648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.193920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.238265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:07.239492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:07.275410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:07.304358 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:07.361409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:07.469609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:07.583331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:07.591196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a41c-e0b9-49cf-b59d-a2f36ff73164 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:07.637071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:07.637718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.638003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.638279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.658146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:07.664678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:07.665725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:07.666783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:07.667671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:07.671544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:07.861062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcff12-97f5-4e0b-b4c3-824d59dca9cf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:07.906108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a00090-5134-489e-acb2-f4c29e7ca54c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:07.933204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:07.934195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.934678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.935151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.946778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:07.947640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.947983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.948337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.949073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:07.949440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:07.950907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:07.957685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:07.959766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:07.964239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:07.965199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ad599203-4fec-4454-bfd2-6463474ce30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 13:59:07.976751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:07.977636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 13:59:07.978425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 13:59:07.978425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 13:59:07.978425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:07.980230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:07.981755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27d04-b5e3-4df6-8434-a991c861cb05 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:07.982236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27d04-b5e3-4df6-8434-a991c861cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:07.982710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27d04-b5e3-4df6-8434-a991c861cb05 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:07.984563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:07.985519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed27d04-b5e3-4df6-8434-a991c861cb05 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:07.986394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.002741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.077602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fa80-0035-4005-8ba3-d26f9d81ed39 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.115790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.116636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.117074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.117479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.118292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.119920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.125662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed27d04-b5e3-4df6-8434-a991c861cb05 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.176541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.177429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.177845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.178332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.180113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.181835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0a928-86f0-4d59-a4d7-28376387181b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.183752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 17/32] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:07 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:08.190139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.190628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.191095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.213902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:08.215156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:08.257867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 12 13:59:07 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:08.259214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:08.299833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:08.307589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:08.318766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.457637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.478626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81753e9d-9fe0-4826-8ad8-ef38c6f00438 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.528006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.528671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f744a7-da41-4574-a40c-de3523cc338c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.529098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.529517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.530530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.536184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.539143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.545456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 19/35] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:08.553113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:08.609112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.609991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.611426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.612338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.614330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:08.615095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.618410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4569b4-12ae-4e9c-9299-0f3cf944b56b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.646292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 17/36] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 13:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:08.650336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a03e-217c-4512-8584-a25450f0a867 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.650336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a03e-217c-4512-8584-a25450f0a867 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.650336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a03e-217c-4512-8584-a25450f0a867 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.650336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 18/37] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:08.653484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a03e-217c-4512-8584-a25450f0a867 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:08.700198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.732876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb43c-61c6-4b8c-b588-b15d30cbc4de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.782918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.783840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.784127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.784422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] PATH_INFO: `/v3/domains/default/users/4690e95140304ab282894ee992a544f2/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.786349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4690e95140304ab282894ee992a544f2, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.787863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.788308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a03e-217c-4512-8584-a25450f0a867 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:08.828972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:08.829598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.829884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.830169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.830849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:08.832359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281008c-de3a-4eb5-a9f7-847c315cdacb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:08.841677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:08.869033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 19/38] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 13:59:08 2022] POST /identity/v3/projects => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 13:59:08.871100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccd2f3-c46c-449a-a359-1ad928682ff8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:08.871815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccd2f3-c46c-449a-a359-1ad928682ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:08.872523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccd2f3-c46c-449a-a359-1ad928682ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:08.925022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1361 bytes} [Mon Sep 12 13:59:08 2022] PUT /identity/v3/domains/default/users/4690e95140304ab282894ee992a544f2/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 13:59:08.926459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:09.015964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-94ccd2f3-c46c-449a-a359-1ad928682ff8 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:09.018514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94ccd2f3-c46c-449a-a359-1ad928682ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:09.112468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:09.114437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643207d6-c06f-4b35-ad75-834a24a881bd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.114956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643207d6-c06f-4b35-ad75-834a24a881bd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.118401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643207d6-c06f-4b35-ad75-834a24a881bd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.118401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 21/41] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:09.129345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4d635-e766-4b46-a35f-ee9f50fcc24e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:09.129891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.130236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.130524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.162196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:09.163461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:09.175351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:09.175729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.176010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.176284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.176955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:09.178544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:09.182355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:09.203801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 12 13:59:08 2022] POST /identity/v3/roles => generated 225 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:09.258456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:09.413355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:09.519012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63762-86a9-4d95-be1b-27b44b9254d3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:09.550963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:09.553425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:09.554231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.554512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.554782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.556333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:09.557736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:09.574528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 12 13:59:09 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 13:59:09.615801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:09.674741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03ecc-d783-4ea1-9cb9-1c5d556291cc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:09.711335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:09.711999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.712283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.712564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.713810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:09.715381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5ec65-0a10-4f19-be41-15ac1287e4a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:09.717172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:09.723284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:09.784053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:09.833373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12f08-17bc-44f0-abd9-5d7685904622 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:09.870201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:09.870814 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:09.871133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:09.871415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:09.872079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:09.873591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ed83-30fd-4ea4-ab28-ab2cca5edd19 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:09.901172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 13:59:09 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:11.231565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acd39b-ae9c-4d9c-a85d-aee5d4b5198f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:11.232109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acd39b-ae9c-4d9c-a85d-aee5d4b5198f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:11.232109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acd39b-ae9c-4d9c-a85d-aee5d4b5198f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:11.233949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:11.239668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:11.240039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:11.240228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:11.258717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:11.260235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:11.324048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:11.593889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acd39b-ae9c-4d9c-a85d-aee5d4b5198f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:11.692661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acd39b-ae9c-4d9c-a85d-aee5d4b5198f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:11.708622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:11.727113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:11.727755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:11.728037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:11.728310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:11.739111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:11.743978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:11.744857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:11.745597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:11.750890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:11.784516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:11.847285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fa32-406d-4774-9132-09e563722229 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:11.879529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:11.880135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:11.880415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:11.880686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:11.881353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:11.881664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:11.883048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:11.890936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:11.897213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:12.007231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce04591-4db1-4a3f-806c-323aadd78979 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:12.040362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:12.040992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.041273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.041549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.042669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:12.044168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85b00b-dde6-4b1e-8bb2-499cb736d3a5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:12.045783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:11 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:12.051249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:12.062364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e912-43db-41c6-9fb0-aa59402f1de9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.062652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e912-43db-41c6-9fb0-aa59402f1de9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.062928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e912-43db-41c6-9fb0-aa59402f1de9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.064303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 27/52] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:12.069148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.069435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.069710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.088305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:12.089495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:12.132517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:12.150182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:12.154289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60b05-e205-44d0-a1b0-9a1c2ff805ba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:12.160538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:12.187354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:12.187994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.188279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.188555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.189669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:12.191179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:12.192749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:12.198494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:12.294842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9cad-ec6d-4d72-aa03-1e24147721d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:12.327897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:12.328500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.328779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.329052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.329781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.domain.id=default, user.id=4690e95140304ab282894ee992a544f2) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:12.330086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:12.331572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:12.338439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Sep 12 13:59:12 2022] GET /identity/v3/role_assignments?user.id=4690e95140304ab282894ee992a544f2&scope.domain.id=default&role.id=c0a540da48234e2db9dc1b474267f52f => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:12.426071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:12.528632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8470-5c6d-4d28-b8fa-ba54589282b5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:12.562146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:12.562776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.563120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.563360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.564455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:12.565890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa1295-e090-41f6-b16e-952bbcae6cf4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:12.567473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:12.573031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:12.611330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:12.669752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d2a0-0d89-40c7-99ec-d95e7a4ddc9a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:12.705244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:12.705780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:12.706060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:12.706331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:12.706972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:12.708454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406d9a-f84b-489b-b781-1e963927ce08 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:12.734112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Sep 12 13:59:12 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:14.837279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3872-6a75-40a5-ad15-b77b5c95eae1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:14.837794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3872-6a75-40a5-ad15-b77b5c95eae1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:14.837877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3872-6a75-40a5-ad15-b77b5c95eae1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:14.839194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:14.844757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:14.845143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:14.845308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:14.864164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:14.865331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:14.929463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:15.194584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3872-6a75-40a5-ad15-b77b5c95eae1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:15.332182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:15.397940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3872-6a75-40a5-ad15-b77b5c95eae1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:15.429048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:15.429662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:15.429941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:15.430211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:15.431323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:15.432789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef9b54-10bf-4d28-a5a4-eea45c30d56b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:15.434336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:15.440331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:15.461283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:15.536704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf584-a81f-440f-a862-ec228d0e213c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:15.569076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:15.569677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:15.569958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:15.570232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:15.570892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:15.572382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2ce4b-42f2-480e-b40f-b808455c0402 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:15.598403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:15 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:18.795940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8117-d18d-4d51-b4e7-4a5e366b1a5d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:18.796940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8117-d18d-4d51-b4e7-4a5e366b1a5d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:18.797497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8117-d18d-4d51-b4e7-4a5e366b1a5d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:18.799091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:18.804637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9f5a-4855-436e-b54e-ca0c65282552 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:18.805417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9f5a-4855-436e-b54e-ca0c65282552 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:18.805884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9f5a-4855-436e-b54e-ca0c65282552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:18.825003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eaed9f5a-4855-436e-b54e-ca0c65282552 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:18.827001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eaed9f5a-4855-436e-b54e-ca0c65282552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:18.925887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:19.019024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d71569-225b-4094-9b1e-a00e0da9d0e4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.019670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d71569-225b-4094-9b1e-a00e0da9d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.020140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d71569-225b-4094-9b1e-a00e0da9d0e4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.021992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 31/64] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:19.027119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0435-eed2-4498-a1b9-976efb71999d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.027420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0435-eed2-4498-a1b9-976efb71999d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.027702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0435-eed2-4498-a1b9-976efb71999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.045772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:19.054160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-df1f0435-eed2-4498-a1b9-976efb71999d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:19.055892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-df1f0435-eed2-4498-a1b9-976efb71999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:19.147585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:19.321344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9421-317f-4041-8b0a-d104cdd3fa88 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.321982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9421-317f-4041-8b0a-d104cdd3fa88 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.322480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9421-317f-4041-8b0a-d104cdd3fa88 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.324056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:19.330128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95609-5178-4ba0-86b2-cb7b1ce98ee5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.330633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95609-5178-4ba0-86b2-cb7b1ce98ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.331135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95609-5178-4ba0-86b2-cb7b1ce98ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.348457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9421-317f-4041-8b0a-d104cdd3fa88 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.360465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3d95609-5178-4ba0-86b2-cb7b1ce98ee5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:19.361680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3d95609-5178-4ba0-86b2-cb7b1ce98ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:19.434104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:19.435593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5d94-950e-4d60-afaf-716c6ced7bbc None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.436431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5d94-950e-4d60-afaf-716c6ced7bbc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.436813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5d94-950e-4d60-afaf-716c6ced7bbc None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.442091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 36/68] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:19.444403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.444897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.445452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.464146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:19.465691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:19.473312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9421-317f-4041-8b0a-d104cdd3fa88 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:19.475005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:19.517498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:19.518245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.518534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.518811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.532975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:19.538030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:19.540273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:19.541185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:19.542393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 33/69] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:19.549019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.552687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 37/70] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:19.610268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.660766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f5a6-c902-4838-8b9e-8b74fcf1cfcf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:19.698854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:19.699998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.700451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.700891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.702340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:19.702836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:19.704536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbed6c-df18-4365-98d8-1947d76062e5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:19.715156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 34/71] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:19.717886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9d7a-3ac5-4399-9df8-5ca6e8803b68 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.718506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9d7a-3ac5-4399-9df8-5ca6e8803b68 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.719126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9d7a-3ac5-4399-9df8-5ca6e8803b68 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.720728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 35/72] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:19.726913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.727084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.727418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.743291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf66ec-2d35-40fb-9586-c074432a0b76 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:19.745531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:19.746778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:19.764941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:19.784682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:19.785360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.785643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.785914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.796204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:19.801048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:19.801882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:19.802649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:19.804307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.818163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:19.818842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.880516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:19.926862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5aa0c-b060-4913-9b84-36ce431ff22e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:19.929509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde29c-8f3d-497a-8250-574f01e9010b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:19.963395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:19.964265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.964549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.964827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.966052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:19.966996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:19.968254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:19.968684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:19.977908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:19.979431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:19.980259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:19.981043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 39/75] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:19.981796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:19.985735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:19.986746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:19.987994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:19.991117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 37/76] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:19.992093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.010842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.094526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473392f-481a-45d4-96ef-5a67b9639b11 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.097369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb0bbf-1186-421d-8f45-bda0a3432c1c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.113307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.137088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.137633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.137920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.138198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.138318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.138870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:20.138979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.139249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.139336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.139538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.140648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.148793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 40/77] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.149585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.150598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:20.156640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:20.158112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 38/78] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:20.159379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.230460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.253676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accee3-d304-4ef0-8862-a5955d103294 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.253813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343e95-4bc5-4667-8b1a-773f9ee2b521 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.287326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.287932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.288218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.288516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.288709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.289181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:20.289314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.289490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.289595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.289847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.290868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.298726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.299535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.333359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.358183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.359900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.399635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6dcd-b3c8-494a-8ead-e628568daf1f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.431925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.432506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.432785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.433057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.434156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.435617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.437735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.443178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.444200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.460307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:20.461146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.536858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.550616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8168-35da-4400-8d09-9dbde37728fd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.559201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50ef6-678e-4831-bd9f-9e901f15acea None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.584197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.584836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.585122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.585403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.586539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.588039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.589620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.594288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.594379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.594379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.594379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.594379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.594693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:20.594693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.595784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.603704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.608370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.659689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.689586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032ba3-9b7b-4e12-86ac-1de6319640b2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.710758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2e48e-4473-4b80-bdcc-7eccd7855a80 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.723811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.724438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.724724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.724998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.726125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.727620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.729179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.729935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.747779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.749011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.749188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.749459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.750106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.751599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.761966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.775354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 43/85] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:20 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:20.776159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.837657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f757b06-a86e-4996-9e98-199df9c6a267 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.876613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.877270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.877556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.877836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:20.879193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:20.880546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:20.882256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 43/86] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:20.884406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:20.899381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:20.900745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321661c-3bbd-4328-8956-d1471987dc9e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:20.942089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:20.942635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:20.942919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:20.943231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.002014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3e72-2f16-4899-b0d8-0956fd6bb331 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.010439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.020410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.021898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.046393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d466-8468-40cf-b600-28611528b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.047052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d466-8468-40cf-b600-28611528b490 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.047346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d466-8468-40cf-b600-28611528b490 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.047624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d466-8468-40cf-b600-28611528b490 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.049251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d466-8468-40cf-b600-28611528b490 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.051070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d466-8468-40cf-b600-28611528b490 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.052866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:21.054486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d466-8468-40cf-b600-28611528b490 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.150701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:21.152037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.164501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.192646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d466-8468-40cf-b600-28611528b490 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.229149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.229876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.230155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.230427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.281051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.294225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32c924-d8c8-4ed6-bc65-762947faef22 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.319519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.321251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.341388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.342183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.342535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.342882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.343717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:21.344119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.346443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.354272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:21.359851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.454209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.509676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:21.510590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.554758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8416a-1cb3-40fd-94fd-9787d592139f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.612189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.613438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.614804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.615298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.680712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.692377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aeb1b-97b5-4373-b655-7b0bc9a29db3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.732291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.733782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.734450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.735811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.738307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.741099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.743172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:21.745118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.778441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.780826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.830380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:21.892772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ee778-9cf0-4e42-a16b-6b435cfd13b1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:21.944649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:21.945654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:21.946138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:21.946584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] PATH_INFO: `/v3/projects/65e7fb9f9ab644ef90d6ebca62940909` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:21.951748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] RBAC: Authorizing `identity:get_project(project_id=65e7fb9f9ab644ef90d6ebca62940909)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:21.953382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:21.955393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/projects/65e7fb9f9ab644ef90d6ebca62940909 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:21.956455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:21.961257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 46/93] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:21.962048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:22.030559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:22.106727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c9c6-7860-4286-bad4-4d4fdebc1dcb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:22.130359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7979bd-db13-450c-8329-48a057125d49 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:22.144886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:22.168322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:22.169003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:22.169293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:22.169572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:22.170385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=4690e95140304ab282894ee992a544f2) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:22.170699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:22.172199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:22.178016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/role_assignments?user.id=4690e95140304ab282894ee992a544f2&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:22.178923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:22.199857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:22.200496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:22.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:22.201048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:22.202363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=65e7fb9f9ab644ef90d6ebca62940909, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:22.202670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:22.204210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:22.219523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:21 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=65e7fb9f9ab644ef90d6ebca62940909&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:22.296579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2786-0b14-4529-aeae-ab5e92a18d7d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:22.337142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:22.337812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:22.338098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:22.338381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:22.339694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:22.341291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43307d-45c9-4aec-9c20-e4ab0a6b1e39 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:22.343416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:22 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:22.349376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:22.541803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d675b-8769-432a-b43c-3525fc1f64ff None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:22.569560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:22.587246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:22.588127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:22.588589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:22.589040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:22.590057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:22.590546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:22.592829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3861b-f76e-42b1-b2c6-f3cd1d321786 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:22.603399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:22 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=22655a77c5404228b6c11450a3edffc1 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:23.660600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d26d-c265-4ee0-8097-5aecbc1c7549 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:23.661111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d26d-c265-4ee0-8097-5aecbc1c7549 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:23.661214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d26d-c265-4ee0-8097-5aecbc1c7549 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:23.662514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:23.668230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:23.668719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:23.668794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:23.690086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:23.691329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:23.739432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72584-70e3-4861-84da-1aebe6c64eac None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:23.739784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72584-70e3-4861-84da-1aebe6c64eac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:23.740070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f72584-70e3-4861-84da-1aebe6c64eac None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:23.741443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 51/99] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:23.770600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:23.770893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:23.771198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:23.794735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 49/100] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:23.808078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:23.809303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:23.871384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:23.909463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:24.204374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:24.237476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:24.353970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a601-3b48-4658-95f3-ab732cc9eda7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:24.375396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:24.407819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:24.408832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.409307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.409769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.412036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:24.413816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:24.415930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 50/102] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:24.421540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:24.434828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953559-6d55-4397-a7d8-00cd71f85cbd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:24.517717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:24.518709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.519163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.519581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.537485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c66db507-5c3c-42f9-a098-c8b7d591ce77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:24.550495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:24.551605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:24.552567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:24.554633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:24.556926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a84e-395f-4f76-904a-5908e6b29b3f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.558197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a84e-395f-4f76-904a-5908e6b29b3f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.559782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a84e-395f-4f76-904a-5908e6b29b3f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.561219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 54/104] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:24.562756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a84e-395f-4f76-904a-5908e6b29b3f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:24.600963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6b22-d5c0-427f-8658-9494062b8b4e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:24.629780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:24.658811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:24.659710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.660164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.660594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.661393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:24.663566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f55c0-8ae1-4164-856a-551897a35e12 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:24.726805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 51/105] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 13:59:24 2022] POST /identity/v3/projects => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 13:59:24.730135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.731451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.731889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.776733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:24.778521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:24.794683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a84e-395f-4f76-904a-5908e6b29b3f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:24.859319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:24.875132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:24.887168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:24.898684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 55/106] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:24.905765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:24.956689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 52/107] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:25.045959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87487b-fdbe-426c-9d4c-3f51ad6d4376 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:25.053435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:25.087427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:25.088078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.088363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.088645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] PATH_INFO: `/v3/users/fe37b0d8a0dd4e93bb262783becabd48` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.123830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] RBAC: Authorizing `identity:get_user(user_id=fe37b0d8a0dd4e93bb262783becabd48)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:25.128250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:25.130026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 56/108] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:24 2022] GET /identity/v3/users/fe37b0d8a0dd4e93bb262783becabd48 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:25.137860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:25.350225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:25.365264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72b28a-2188-470a-bfa0-4815f20ba926 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:25.471601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73247083-413c-4127-8673-f76c1563a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:25.472252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247083-413c-4127-8673-f76c1563a6de None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.472541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247083-413c-4127-8673-f76c1563a6de None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.475051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247083-413c-4127-8673-f76c1563a6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.540568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3aa0-8882-4813-a286-bce83368ba2f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:25.553456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:25.575985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:25.577214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.577601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.577880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.589743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8bc73b3b-1dce-4e2f-81a3-df2a9f0e808b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:25.595932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:25.596792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:25.598182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 57/109] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:25.598812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f0df-1c1c-49e0-a48e-216187d83d63 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.599077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f0df-1c1c-49e0-a48e-216187d83d63 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.599357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f0df-1c1c-49e0-a48e-216187d83d63 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.600896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 58/110] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:25.603004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917f0df-1c1c-49e0-a48e-216187d83d63 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:25.622242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:25.675884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73247083-413c-4127-8673-f76c1563a6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:25.677392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73247083-413c-4127-8673-f76c1563a6de None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:25.713360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917f0df-1c1c-49e0-a48e-216187d83d63 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:25.750360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:25.750951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.751278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.751593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.752389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:25.752707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:25.754207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a99eb-7382-46fc-b67f-8efae387bec7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:25.765858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 59/111] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:25.767339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.767639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.767917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.789017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:25.790334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:25.876238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:25.877460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:25.891374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:25.911356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 53/113] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:25.913413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8ccc-154d-4ca9-b80a-0363a2dcfa4c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:25.916117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8ccc-154d-4ca9-b80a-0363a2dcfa4c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:25.916117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8ccc-154d-4ca9-b80a-0363a2dcfa4c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:25.916117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 54/114] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:25.916951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8ccc-154d-4ca9-b80a-0363a2dcfa4c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.004029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:26.032932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dce76-a53f-4cd6-8af2-9c8aab0c70d9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.053063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8ccc-154d-4ca9-b80a-0363a2dcfa4c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.080909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.082102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.082817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.083308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.085476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:26.088181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed627ea-fd5a-4260-8536-0c4621986803 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:26.090669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 61/115] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:25 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:26.092048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed779-5135-4821-9fe0-4bfdbedf9dac None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.092536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed779-5135-4821-9fe0-4bfdbedf9dac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.093005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aed779-5135-4821-9fe0-4bfdbedf9dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.100475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.102013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.102303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.102580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.103745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:26.105208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa408-a658-4fc8-9057-af83d194e054 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:26.111789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 55/116] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:25 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:26.113709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3757-ee06-4c68-92c7-a7b3735934c1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.113709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3757-ee06-4c68-92c7-a7b3735934c1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.113928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3757-ee06-4c68-92c7-a7b3735934c1 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.115283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 56/117] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:26.119630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3757-ee06-4c68-92c7-a7b3735934c1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.126133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-14aed779-5135-4821-9fe0-4bfdbedf9dac None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:26.128183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-14aed779-5135-4821-9fe0-4bfdbedf9dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:26.204171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 62/118] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:26.205369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.205673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.205943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.230076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:26.235992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:26.237339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:26.242064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3757-ee06-4c68-92c7-a7b3735934c1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.279139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.280643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.281177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.281699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.283110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:26.284856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:26.287098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 57/119] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:26.288201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.317579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 63/120] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:26.317746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:26.317890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.429886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2f86-81eb-420a-bb1b-1926ee8f8bd6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.466183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e426b0-1614-4554-a82b-ed1e808c3eb7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.492567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.493571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.494050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.494520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.495502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=fe37b0d8a0dd4e93bb262783becabd48) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:26.496026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:26.497670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:26.503384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 58/121] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/role_assignments?user.id=fe37b0d8a0dd4e93bb262783becabd48&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=af95450dde3449548e4b314b8bef159a => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:26.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.526046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.527479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.529362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.530528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.538219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:26.563868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:26.569042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:26.569977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:26.570756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 64/122] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:26.571429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.622960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:26.668586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd69fd-bb63-4989-ba5a-99cd722fb840 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.715172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.715172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.715582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.715780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/e934d55fcbc2436b925f31333bafe076/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.719344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, user_id=e934d55fcbc2436b925f31333bafe076, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:26.720941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:26.738894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 59/123] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:26 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/e934d55fcbc2436b925f31333bafe076/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:26.740123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.758463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff71673-abc2-46c6-a3f7-091cdc8a7806 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.797429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:26.798017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:26.798300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:26.798573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:26.828307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:26.834912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:26.835888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:26.836685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:26.843290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 65/124] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:26.845161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:26.919673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d781-0f36-486c-8c3e-f88d09dfa733 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:26.952869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.002292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.005215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088cb1f-cc02-4e5c-8785-bc3b6dc834b8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.013083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.014791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.015126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.015416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.016110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:27.016426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.018688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.030373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 60/125] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.031806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.054432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.055502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.056036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.056509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.067892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:27.073236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:27.074107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:27.074879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:27.077916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 66/126] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:27.078906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.190538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b410c-23bc-4660-a373-70ee1663d2df None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.245010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05abc5-583b-4900-a6cd-a1d59d3861d8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.260676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.266502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.267161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.267442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.267768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.268449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:27.268750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.270167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.285622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.286495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.287049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.287473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.288789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.290544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.292718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 67/127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.293651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.294706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 61/128] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.300927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.408197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277e65-e0f2-44dd-9b25-eddec0a3df36 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.411417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.445825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.446715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.448029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.448461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.449285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:27.449741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.451413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.461617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 68/129] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.462736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.504052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de08c8-c67c-4f44-8e14-2585e51fff91 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.517506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.583191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc2bd-b932-45ca-98d3-4b5e062bba1c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.583751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.584478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.584773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.585058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] PATH_INFO: `/v3/projects/65e7fb9f9ab644ef90d6ebca62940909` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.586388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] RBAC: Authorizing `identity:get_project(project_id=65e7fb9f9ab644ef90d6ebca62940909)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.587884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.593432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 62/130] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/projects/65e7fb9f9ab644ef90d6ebca62940909 => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:27.594384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.629487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.630501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.631013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.631519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.632895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.634913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.636763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 69/131] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.638176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.737451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e7c73-bdb2-457c-9ecd-fd7300ab907c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.759986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664fa91-e4f2-4dd4-8b4d-63b4e2f67b66 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:27.760902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.777152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:27.785363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.786626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.786996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.787372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.788848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.791115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.797465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 63/132] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:27.797465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.810471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:27.812522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.813307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.813789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] PATH_INFO: `/v3/projects/65e7fb9f9ab644ef90d6ebca62940909/users/e934d55fcbc2436b925f31333bafe076/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.816223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] RBAC: Authorizing `identity:create_grant(project_id=65e7fb9f9ab644ef90d6ebca62940909, user_id=e934d55fcbc2436b925f31333bafe076, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:27.817891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d299067-7d55-4d21-98b7-c5f6ed82d7ed None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:27.835808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 70/133] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:27 2022] PUT /identity/v3/projects/65e7fb9f9ab644ef90d6ebca62940909/users/e934d55fcbc2436b925f31333bafe076/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:27.837422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949f7e-d6b9-4f73-9a8a-b85089eb8829 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:27.838205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949f7e-d6b9-4f73-9a8a-b85089eb8829 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:27.839432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949f7e-d6b9-4f73-9a8a-b85089eb8829 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:27.840959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 71/134] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:27.841556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949f7e-d6b9-4f73-9a8a-b85089eb8829 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:27.961743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354744f8-b564-439a-a0eb-1da1376d5db6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.028609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949f7e-d6b9-4f73-9a8a-b85089eb8829 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.035013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.035705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.035987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.036265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.040073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.041855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b2772-d5e9-4c2a-aad2-9772f626cf6d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:28.044390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 64/135] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:28.045404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.045693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.045972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.085690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:28.085690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:28.100985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.102016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.102495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.102965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.104346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.106073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:28.108638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 72/136] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:27 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:28.109661 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:28.157381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:28.169243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:28.185541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 65/137] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:28.187516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:28.239654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf454-dbb3-4fa2-a099-95c0ad824c8f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.276531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.277355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.277731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.278454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/e934d55fcbc2436b925f31333bafe076/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.280631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, user_id=e934d55fcbc2436b925f31333bafe076, role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.283186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:28.298202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 73/138] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:28 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/e934d55fcbc2436b925f31333bafe076/roles/22655a77c5404228b6c11450a3edffc1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:28.323950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee5f4f-909d-4a4e-bfc8-e8e2618279d9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.367140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.368201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.368654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.369121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/4690e95140304ab282894ee992a544f2/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.371431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, user_id=4690e95140304ab282894ee992a544f2, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.373753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:28.401573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 66/139] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:28 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/4690e95140304ab282894ee992a544f2/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:28.646156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:28.763591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:28.768587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a57ea-1d88-49e0-b565-a38756cea3dc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.813536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.814200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.814628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.815108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.819805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.821326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd155d6-9570-4b15-be8a-370a3c660e28 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:28.823041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 74/140] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:28.829307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:28.888085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:28.949123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31380-291e-4560-87be-705fda07ac31 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:28.990734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:28.992156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:28.992655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:28.993124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:28.994013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:28.995708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a3061-8d0c-4c7f-8c2a-ee6ab1376725 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:29.030741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 67/141] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:28 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:29.351448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f414f-e499-4227-b127-886592ec1bbf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:29.351989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f414f-e499-4227-b127-886592ec1bbf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:29.351989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f414f-e499-4227-b127-886592ec1bbf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:29.353632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 75/142] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:29.358705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658bac-2f9b-4afe-abf4-e3bcf7c4d078 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:29.359336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658bac-2f9b-4afe-abf4-e3bcf7c4d078 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:29.359860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658bac-2f9b-4afe-abf4-e3bcf7c4d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:29.383808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e3658bac-2f9b-4afe-abf4-e3bcf7c4d078 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:29.385370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3658bac-2f9b-4afe-abf4-e3bcf7c4d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:29.466413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 68/143] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:29.614112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee177-be0b-48c4-a613-d0eaaa8f4571 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:29.614703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee177-be0b-48c4-a613-d0eaaa8f4571 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:29.615234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee177-be0b-48c4-a613-d0eaaa8f4571 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:29.616943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 76/144] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:29.623567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:29.624128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:29.624601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:29.644518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:29.646041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:29.673269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:29.719753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 69/145] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:29.998943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee177-be0b-48c4-a613-d0eaaa8f4571 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.009739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.213839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee177-be0b-48c4-a613-d0eaaa8f4571 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.224848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baab3c-d9cb-4970-b211-697d91d1efef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.284315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.284963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.285344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.285628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.293277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.293941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.294228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.294507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.298364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:30.304304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:30.305241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:30.306271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 70/146] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:30.311878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.316139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:30.321809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:30.324012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:30.325909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 77/147] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:30.338422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.342546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:30.395216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:30.431893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88c3e-08d3-45ec-80aa-2f19f2af46bc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.469049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.469731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.470020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.470299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.470977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:30.471328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:30.472848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:30.481686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 71/148] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:30.490112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.535602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f92a0f-e3bb-49d8-8317-5fcefd580e5c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.589864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.590582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.590869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.591199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.592995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:30.593304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:30.599060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:30.609001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 78/149] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:30.615865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.672522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:30.714734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a25a-735a-474b-ad93-67a4edd9f839 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.751424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:30.772410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0442-eef9-47f3-9f7f-fd86f561ac36 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:30.794351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.794999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.795336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.795614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] PATH_INFO: `/v3/users/fe37b0d8a0dd4e93bb262783becabd48` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.797689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] RBAC: Authorizing `identity:get_user(user_id=fe37b0d8a0dd4e93bb262783becabd48)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:30.799761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:30.801968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 72/150] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/users/fe37b0d8a0dd4e93bb262783becabd48 => generated 289 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:30.807659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:30.843263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:30.844561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:30.845060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:30.845540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:30.847132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:30.848994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:30.854482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 79/151] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:30.859592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:31.006130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d2b71-3909-4f62-aaee-c79cb02bd391 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:31.052612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349792-7c92-4a41-bbe4-278cfbef88dd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:31.068690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:31.069997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.070516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.070984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.072399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:31.074093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de797e67-9a8f-4d31-8789-bdd3bc13951e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:31.075984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 73/152] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:31.080582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b82ea-34c9-4198-a5a2-627d7b27bff9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.081111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b82ea-34c9-4198-a5a2-627d7b27bff9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.081593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b82ea-34c9-4198-a5a2-627d7b27bff9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.083108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 74/153] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 13:59:31.084000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b82ea-34c9-4198-a5a2-627d7b27bff9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:31.109615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:31.113714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:31.113714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.113908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.114089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.164995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:31.256400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b82ea-34c9-4198-a5a2-627d7b27bff9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:31.258894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:31.260408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:31.314588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:31.315218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.315501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.315774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/fe37b0d8a0dd4e93bb262783becabd48/roles/af95450dde3449548e4b314b8bef159a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.317762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, user_id=fe37b0d8a0dd4e93bb262783becabd48, role_id=af95450dde3449548e4b314b8bef159a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:31.319376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7abb9-5a81-4b47-966a-1235905956a3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:31.347520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 75/154] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:31 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/users/fe37b0d8a0dd4e93bb262783becabd48/roles/af95450dde3449548e4b314b8bef159a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:31.348770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.349063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.349343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.387530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:31.396941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:31.491517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 80/155] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:31.496895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:31.551347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:31.630591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:31.679698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d7802-ddcf-4aab-89e9-24331ca97cea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:31.730897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:31.731592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.731875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.732148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.733952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:31.735465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:31.737554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 81/157] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:31 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:31.743561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:31.758254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:31.894268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19925-6209-49f9-8991-dca70a571267 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:31.938462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:31.939106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:31.939392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:31.939667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:31.940432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:31.940721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:31.942189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59a9e2-8230-4eb3-9a0a-ca60e96e3902 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:31.948767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 77/158] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:31 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:31.964807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:32.122660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2a98c-8902-4fe0-969a-1565c73daaa0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:32.159538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:32.168087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:32.168739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.169020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.169296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.185225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:32.190851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:32.191868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:32.193636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 82/159] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:32.194496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd531-2fc7-4573-ad3c-011a205bf1ad None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.196866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd531-2fc7-4573-ad3c-011a205bf1ad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.196866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd531-2fc7-4573-ad3c-011a205bf1ad None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.197180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 78/160] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:32.198019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:32.203059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fdb9-6045-48c6-9df1-022726d09d0b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.203356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fdb9-6045-48c6-9df1-022726d09d0b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.203636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fdb9-6045-48c6-9df1-022726d09d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.224502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b7c8fdb9-6045-48c6-9df1-022726d09d0b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:32.225929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b7c8fdb9-6045-48c6-9df1-022726d09d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:32.308121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 79/161] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:32.309586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cef7-7d55-4d09-9b12-c1bf6d1a3eeb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.309874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cef7-7d55-4d09-9b12-c1bf6d1a3eeb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.310148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1cef7-7d55-4d09-9b12-c1bf6d1a3eeb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.316341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 80/162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:32.322373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.322652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.322931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.333329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:32.351141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:32.352342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:32.430048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e8f4-72d1-437d-84a6-481d73acbbc3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:32.450943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 81/163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:32.477651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:32.478280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.478564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.478840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.479562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:32.479868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:32.481266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:32.490902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:32.496722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:32.651966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1545c-4647-445f-a31c-32a491ec49e9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:32.687354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:32.693350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:32.694007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.694335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.694614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.696728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:32.698226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:32.700302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:32 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:32.707804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:32.788924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:32.849130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550d09-af22-413f-b7db-f2354ef1c8c9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:32.886476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:32.887117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:32.887408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:32.887695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:32.973865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:32.975389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:32.981743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.045955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:33.118255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 84/166] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:33.123904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.141392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699568-271a-4531-921b-03975e5ee4cd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.178863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.179805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.180281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.180703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.198111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:33.204214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:33.205136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:33.206082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:33.208652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:33.209677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.278150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:33.323975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a2fd-6f8d-4171-a2df-56610d810e9d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.333171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135862d9-3a2a-4024-88c0-6325e08093f7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.362243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.363635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.364168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.364708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] PATH_INFO: `/v3/projects/65e7fb9f9ab644ef90d6ebca62940909` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.366036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] RBAC: Authorizing `identity:get_project(project_id=65e7fb9f9ab644ef90d6ebca62940909)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:33.367735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:33.369596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 84/168] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/projects/65e7fb9f9ab644ef90d6ebca62940909 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:33.370567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.412642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.413287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.413743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.414163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.438430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:33.443704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:33.444725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:33.445734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:33.455449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 85/169] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:33.456429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.475499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:33.494291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50b287-33f7-4b41-a8da-a44f4a7da7bf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.550129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:33.566563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.567213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.567493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.567762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.568434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:33.568736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:33.570148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:33.587090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 85/170] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:33.587758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.653767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18cc7-e797-4dbf-ac34-0a77563439b0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.722965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.723600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.723883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.724157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.724895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=65e7fb9f9ab644ef90d6ebca62940909, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:33.725201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:33.726658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:33.745457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=65e7fb9f9ab644ef90d6ebca62940909&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:33.746302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.797175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8cf46-dca0-4aed-b634-01ae351056c2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.868705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:33.893300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.893942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.894228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.894505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.895206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:33.895510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:33.896905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:33.915616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 86/172] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:33.916808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2db4-fd07-475b-9f05-37d560a9a140 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:33.921731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:33.976425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:33.977130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:33.977415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:33.977681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] PATH_INFO: `/v3/users/4690e95140304ab282894ee992a544f2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:33.979165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] RBAC: Authorizing `identity:get_user(user_id=4690e95140304ab282894ee992a544f2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:33.980893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:33.982762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 87/173] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/users/4690e95140304ab282894ee992a544f2 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:33.988939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:34.054349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.174122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765a0e-75d1-4bd1-9e1c-d3ad61228100 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:34.208738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298a0b3-f34f-44e6-94f7-0c137d1df6cf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:34.250113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:34.250814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.251115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.251393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] PATH_INFO: `/v3/users/e934d55fcbc2436b925f31333bafe076` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.253575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=e934d55fcbc2436b925f31333bafe076)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:34.255046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b90e-0251-4032-83c2-f1ee47b42fb1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:34.261287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/users/e934d55fcbc2436b925f31333bafe076 => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:34.262819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586333-8841-4761-bdff-691bd1340937 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.265048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586333-8841-4761-bdff-691bd1340937 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.266163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586333-8841-4761-bdff-691bd1340937 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.268219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 88/175] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:34.272479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586333-8841-4761-bdff-691bd1340937 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:34.281351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:34.288025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.288483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.288902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.312996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.376729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:34.378199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516e5dd-78eb-4f76-8079-06b9a70ec52d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:34.423739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586333-8841-4761-bdff-691bd1340937 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:34.457111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.481506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 88/176] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:34.483552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491040a2-f024-4d6d-af05-d963762331ff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.483982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491040a2-f024-4d6d-af05-d963762331ff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.484421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491040a2-f024-4d6d-af05-d963762331ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.490312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:34.491060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.491364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.491636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.504143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-491040a2-f024-4d6d-af05-d963762331ff None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:34.505655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-491040a2-f024-4d6d-af05-d963762331ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:34.541483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.570712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:34.572326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a2bfd-27bc-413d-8269-b9adc3260537 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:34.578289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 89/177] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:34.587056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156777-a81b-4052-9559-466408cd084f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.587651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156777-a81b-4052-9559-466408cd084f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.588080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156777-a81b-4052-9559-466408cd084f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.589931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 90/178] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:34.590818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02156777-a81b-4052-9559-466408cd084f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:34.686827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 89/179] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:34.688589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.688722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.688961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.721664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:34.722960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:34.735303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02156777-a81b-4052-9559-466408cd084f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:34.765336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.791672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:34.793365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:34.793780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:34.794226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:34.796335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:34.799183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:34.802277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 91/180] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:34 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:34.803415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:34.875877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 90/181] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:34.881607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:34.892610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:34.969812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a016b-cc49-4f4d-b1a3-abec34681d77 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.022883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.023779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.024380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.024796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.026877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.028499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38203cb1-565b-4e5b-9d69-025c73ca7fd8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.031376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 92/182] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:34 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.032685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcc23-92f5-4eb8-a7ab-11f5d821be5b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.033117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcc23-92f5-4eb8-a7ab-11f5d821be5b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.033540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcc23-92f5-4eb8-a7ab-11f5d821be5b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.034879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 93/183] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:35.035779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcc23-92f5-4eb8-a7ab-11f5d821be5b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.051208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cce9b-3a65-4bb0-9f9a-d44ecbf6b12c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.089124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.089731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.090200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.090609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.092208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=4690e95140304ab282894ee992a544f2) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:35.092773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.094400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.101233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 91/184] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:34 2022] GET /identity/v3/role_assignments?user.id=4690e95140304ab282894ee992a544f2&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.108234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.137361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.161365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcc23-92f5-4eb8-a7ab-11f5d821be5b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.175402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.210124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.210352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.210631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.210975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.222812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-89ff5c40-9d83-442b-a9f7-9549102d4e71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:35.228582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:35.229517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:35.230331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 94/185] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:35.231016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.232907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.232907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.250444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5aa25-1878-485c-a4d7-3bcafa35ea3b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.256591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:35.258699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:35.288341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.288897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.289148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.289420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.290162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=e934d55fcbc2436b925f31333bafe076) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:35.290469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.291937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab613-e9bc-491f-ae80-4b450aff0c16 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.300156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 92/186] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/role_assignments?user.id=e934d55fcbc2436b925f31333bafe076&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=22655a77c5404228b6c11450a3edffc1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.303152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f2fd-87a5-473f-a07d-0930e418c1b2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.303446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f2fd-87a5-473f-a07d-0930e418c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.303724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f2fd-87a5-473f-a07d-0930e418c1b2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.304992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 93/187] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:35.305780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98f2fd-87a5-473f-a07d-0930e418c1b2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.351088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 95/188] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:35.351088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.405691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.432378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98f2fd-87a5-473f-a07d-0930e418c1b2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.474009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.474662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.474937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367135e-9978-4358-a76d-c03e8ad90445 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.475127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.475302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.489051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.497326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3336e591-58b1-4797-abef-2c19680cb61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:35.503462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:35.504339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:35.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:35.507802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 94/189] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:35.511450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.511734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.512007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.521343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.522046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.522418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.522768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.523568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:35.523929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.525395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.533525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:35.534714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:35.538221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.539177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.632651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 95/191] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:35.639293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.671678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0566bd-a479-4b58-a2b4-13ccf0662de6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.709001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.714204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.714823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.715133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.715411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.716083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:35.716390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.718219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.733388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.733388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.744006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8203a-7aa5-4b52-9e2f-b5a9c3c7c74b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.756591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.782628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.783467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.783821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.784096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.798342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.799798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.801404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 96/193] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.805944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.842384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81006f0a-be42-4753-9034-4da7db402cf9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.878010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.878643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.878925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.879227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.880352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.881790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.883398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 98/194] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.888505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.909660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504254ae-f3e5-42e0-94ba-e6e9cd814ae7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:35.945246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.956946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:35.957949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:35.958398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:35.958868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:35.960776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:35.962792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:35.964459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 97/195] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:35.965202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:35.983684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:35.995922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784d497-9ec4-4ab9-8cef-a04fa2b70a78 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.028858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.030024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.030306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.030580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.062676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704168-5a53-4d46-9de7-a5344616126c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.096040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.096192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.096636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.096913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.097186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.097582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.097830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.099278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.123313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 98/196] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:35 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:36.123952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.177300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.213695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.237550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:36.237550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.244935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909d70-8f74-48fb-9ce2-7039d40bc8fa None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.283784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.284428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.284700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.284968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.296708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:36.302137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:36.303014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:36.303858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:36.304517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.357622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05f092-cfe6-4fe2-86c9-f860a41a2d02 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.399155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.399816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.400160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.400437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.425316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00848-cf57-49ec-81b0-c5442647d0e8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.439977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.467986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.468629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.468907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.469181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.471067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.471822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.473459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 100/199] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:36.474216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.481088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.498644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.500517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.589296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7bee5-7771-4bdb-a562-8acf6b8bdf3a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.624080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 100/200] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:36.625217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.637003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.638020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.638322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.638629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.639336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:36.639808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.641595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.653169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:36.659165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.713848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.737110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:36.755325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7356aa-781a-4ee4-a3fa-d09889663316 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.783895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e6ab-cbfa-45f3-b632-b24a888e290d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:36.800090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.801248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.801696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.802158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.803103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=b5e77901158b4e47bd680f9d1c00b7df) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:36.803584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.805198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.811461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 101/202] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/role_assignments?user.id=b5e77901158b4e47bd680f9d1c00b7df&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:36.812528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.832923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:36.834012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:36.834618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:36.836720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:36.840074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:36.842559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:36.849531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 102/203] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:36.856062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:36.966565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8862-bcbf-4ebd-802d-46fad2d381fc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:37.024308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:37.024951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:37.025230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:37.025502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] PATH_INFO: `/v3/users/fe37b0d8a0dd4e93bb262783becabd48` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:37.026642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=fe37b0d8a0dd4e93bb262783becabd48)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:37.028320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:37.030987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 102/204] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/users/fe37b0d8a0dd4e93bb262783becabd48 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:37.036200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:37.056586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6e7c-c5d6-41de-bcc3-fd40e8964099 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:37.069812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:37.075456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:37.103686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100925-ad96-495d-809c-8615aa0987be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:37.104303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100925-ad96-495d-809c-8615aa0987be None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:37.104581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100925-ad96-495d-809c-8615aa0987be None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:37.104852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100925-ad96-495d-809c-8615aa0987be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:37.105605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100925-ad96-495d-809c-8615aa0987be None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=b5e77901158b4e47bd680f9d1c00b7df) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:37.114903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100925-ad96-495d-809c-8615aa0987be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:37.114903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04100925-ad96-495d-809c-8615aa0987be None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:37.116228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:36 2022] GET /identity/v3/role_assignments?user.id=b5e77901158b4e47bd680f9d1c00b7df&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=22655a77c5404228b6c11450a3edffc1 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:37.254141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74c5c-9f7f-43b3-a3db-6c4135bdd6e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:37.306807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:37.307466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:37.307750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:37.308025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:37.410572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:37.412082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:37.447383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:37.537978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 103/206] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:37.543653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100925-ad96-495d-809c-8615aa0987be None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:37.693688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04100925-ad96-495d-809c-8615aa0987be None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:37.740041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:37.740683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:37.740960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:37.741230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:37.742344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:37.743823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e3da-1620-4795-84f2-24b7c2f52f8e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:37.745442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 104/207] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:37 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:37.751388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:37.906030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caf55b-b52b-40be-8fa1-c7d3c9d70cce None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:37.935140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:37.955022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:37.955658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:37.955934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:37.956205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:37.956946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472, user.id=fe37b0d8a0dd4e93bb262783becabd48) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:37.957256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:37.958755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9761c-0ea6-4ebf-b951-709ad2117155 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:37.964926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 104/208] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:37 2022] GET /identity/v3/role_assignments?user.id=fe37b0d8a0dd4e93bb262783becabd48&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=af95450dde3449548e4b314b8bef159a => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:38.775840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea30b-6298-4e0c-b64f-190bc73aa3d2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:38.776382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea30b-6298-4e0c-b64f-190bc73aa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:38.776382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea30b-6298-4e0c-b64f-190bc73aa3d2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:38.777892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 105/209] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:38.785071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:38.785864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:38.786677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:38.806417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:38.807984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:38.851483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b55ca-0f36-4b18-92f7-d3c7e56a1adf None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:38.851483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b55ca-0f36-4b18-92f7-d3c7e56a1adf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:38.851757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b55ca-0f36-4b18-92f7-d3c7e56a1adf None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:38.853289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 106/210] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:38.858146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:38.858432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:38.858711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:38.879048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:38.880242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:38.882490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 105/211] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:38.914654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:38.948283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 107/212] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:39.174655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.264091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.282370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2257c-e9a9-4281-8193-1085c03f43fd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:39.299677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:39.324843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:39.325480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.325760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.326084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.337086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:39.341991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:39.342867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:39.343696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 106/213] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:39.351912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.410236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e380e-797a-44e3-95c3-f19aa9384701 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:39.452858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:39.453508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.453798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.454063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.455224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:39.456698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c696b97-22f7-453b-93fd-7bed7d010e88 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:39.458456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 108/214] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:39.460442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d680-a8dc-4d96-9b16-bd710bb3e365 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.460725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d680-a8dc-4d96-9b16-bd710bb3e365 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.460996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d680-a8dc-4d96-9b16-bd710bb3e365 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.462450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 109/215] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:39.468254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d680-a8dc-4d96-9b16-bd710bb3e365 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.479189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8824-fd52-40fb-bfdb-b6ff7ff2c03b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:39.512351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:39.523826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:39.524438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.524714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.524984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.525684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:39.525989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:39.527410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed3f86-ae73-4b73-9d6e-83ed64de6f54 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:39.535340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:39.536603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a17eb5-6741-44e3-a292-001c255a77cf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.536896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a17eb5-6741-44e3-a292-001c255a77cf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.537169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a17eb5-6741-44e3-a292-001c255a77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.554047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-63a17eb5-6741-44e3-a292-001c255a77cf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:39.555245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-63a17eb5-6741-44e3-a292-001c255a77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:39.579228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d680-a8dc-4d96-9b16-bd710bb3e365 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:39.583599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:39.612556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:39.613408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.613687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.613958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.614603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:39.616088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da52ee5-aa65-45b3-9550-517c3e332fa4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:39.621260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 108/217] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:39.630146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cce2-a848-4eb7-acc3-63010424e5e4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.630146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cce2-a848-4eb7-acc3-63010424e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.630146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cce2-a848-4eb7-acc3-63010424e5e4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.630146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 109/218] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:39.630146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cce2-a848-4eb7-acc3-63010424e5e4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.640145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 110/219] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:39 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:39.641452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.641733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.642064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.661171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:39.662327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:39.755211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 111/220] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:39.774565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cce2-a848-4eb7-acc3-63010424e5e4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:39.816528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:39.817171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:39.817445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:39.817712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] PATH_INFO: `/v3/users/242c02b7359f4d79bd6a0c10dac19397` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:39.832855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] RBAC: Authorizing `identity:get_user(user_id=242c02b7359f4d79bd6a0c10dac19397)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:39.834309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:39.836013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 110/221] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/users/242c02b7359f4d79bd6a0c10dac19397 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:39.841590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.868442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:39.908771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:39.945044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:39.957368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3554a-30a9-4c6c-b5f3-dd8e4fd7a235 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.003294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.004216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.004481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.004752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.044808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d928c8a-90dd-45b7-87f1-a066596a0195 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.093355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.093555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.093995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.094273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.094543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.094848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.120796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:40.126214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:40.127056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:40.127936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:40.128736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 111/222] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:40.129385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.212277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 112/223] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:40.217384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.244587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.266267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd082f-9c7e-43e8-9c1b-9e6b936ee432 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.305790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.306659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.307250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.307650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.320503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70be31-3788-4f68-b3d4-ebbf564c6b18 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.321066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:40.326913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:40.328006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:40.328987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:40.330904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:40.332034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.350463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.362895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.364094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.364492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.364990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.365617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:40.366077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.367599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.377440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 113/225] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.377711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.443063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ed4a-4787-4414-8d60-f92e0120a000 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.480510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.481691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.481976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.482287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.484223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.485944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.489069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 113/226] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.490640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.505578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd7c8-42d8-4f0a-8089-47e73bc2b27b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.510928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.540868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.541614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.541953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.542290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.543043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:40.543435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.545441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.554373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 114/227] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.555512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.610386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.617615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff44a9-eeac-43c1-9b57-1652ef393608 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.653518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.654464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.654584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.654812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.655961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.657503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.659339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 114/228] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.659998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.668247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad737-7a4f-4547-bdbd-07392068d7d0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.706290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.707377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.707859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.708310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.709219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=242c02b7359f4d79bd6a0c10dac19397) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:40.709706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.711582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.718014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 115/229] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/role_assignments?user.id=242c02b7359f4d79bd6a0c10dac19397&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.719269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.750735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.773167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d27b44-27fb-4c41-8d4e-49049b97672f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.816185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.816841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.817120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.817425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.818783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.820252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.822698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 115/230] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.829065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.845680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4f47-1c78-42d5-814a-acd36d74d32b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.860785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:40.905222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.906215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.906672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.907262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.909052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.912022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.914638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 116/231] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:40.920669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:40.955013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c0e4-f12c-4a44-8385-48ce6fe4a108 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:40.993249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:40.993893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:40.994172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:40.994445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:40.999153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:40.999153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:40.999153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:40 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:41.006375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:41.026238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:41.129021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68269-408b-451b-b05b-8e68a67207d6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:41.149573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c519-6cf0-46a9-8778-d88248b62a8d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:41.195866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:41.196529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:41.196995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:41.197437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/users/b5e77901158b4e47bd680f9d1c00b7df/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:41.202399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, user_id=b5e77901158b4e47bd680f9d1c00b7df, role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:41.203968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16a46-57dd-491e-afbb-6abc3c4078aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:41.218015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:41.218681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:41.218961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:41.219268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/users/b5e77901158b4e47bd680f9d1c00b7df/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:41.221346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, user_id=b5e77901158b4e47bd680f9d1c00b7df, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:41.222796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605eb9-9987-4795-a9d1-65fab2818710 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:41.234688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 117/233] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:41 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/users/b5e77901158b4e47bd680f9d1c00b7df/roles/22655a77c5404228b6c11450a3edffc1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 13:59:41.252791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 117/234] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:40 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/users/b5e77901158b4e47bd680f9d1c00b7df/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:42.292681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b2bf-c227-4f0b-b98a-35fd66521528 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:42.293229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b2bf-c227-4f0b-b98a-35fd66521528 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:42.293229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621b2bf-c227-4f0b-b98a-35fd66521528 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:42.294882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 118/235] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:42.300034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394eeac-43c6-4c16-bfac-c79de1f63d7c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:42.300470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394eeac-43c6-4c16-bfac-c79de1f63d7c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:42.300642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394eeac-43c6-4c16-bfac-c79de1f63d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:42.324423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f394eeac-43c6-4c16-bfac-c79de1f63d7c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:42.325617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f394eeac-43c6-4c16-bfac-c79de1f63d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:42.361899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:42.399111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 118/236] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:42.432047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e673-63ab-420d-bd94-179fc8b5aa0e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:42.432351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e673-63ab-420d-bd94-179fc8b5aa0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:42.432596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e673-63ab-420d-bd94-179fc8b5aa0e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:42.434129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 119/237] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:42.439933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:42.440217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:42.440491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:42.463446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:42.464748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:42.564603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:42.678810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e673-63ab-420d-bd94-179fc8b5aa0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:42.771676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:42.812654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e673-63ab-420d-bd94-179fc8b5aa0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:42.856042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:42.856684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:42.856962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:42.857752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:42.874570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:42.879895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:42.880773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:42.882110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:42.886796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:42.897892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.061575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b066-9856-4a4c-b61c-9384b5f73801 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.062017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:43.065666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055264a-bef3-4aa8-bd54-70089f18bd1e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.098892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.099667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.099961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.100241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.101519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.102983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.104989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 121/240] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:43.111482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.117570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:43.128483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.129409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.129888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.130362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.131269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:43.131789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.133382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.142542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 120/241] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:43.151951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.229650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f746-01b4-410e-a5ed-3268597c125a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.271441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.272064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.272347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.272624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.273283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.274772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.306211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 122/242] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:43 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:43.378038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7db3b-2ae3-43bd-a302-b292fd899a12 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.428421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.429089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.429375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.429655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] PATH_INFO: `/v3/users/53447a9836e14e32b7334a3210173cb5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.454902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] RBAC: Authorizing `identity:get_user(user_id=53447a9836e14e32b7334a3210173cb5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.456563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbb23e-c352-429c-8edd-454307a6e31a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.458407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 121/243] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:43 2022] GET /identity/v3/users/53447a9836e14e32b7334a3210173cb5 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:43.463999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.535190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:43.551438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b794b1-cdcb-478c-b682-bdbb6a94fbf3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.551823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b794b1-cdcb-478c-b682-bdbb6a94fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.552104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b794b1-cdcb-478c-b682-bdbb6a94fbf3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.554334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 122/244] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:43.560868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.561155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.561433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.581517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:43.582704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:43.582903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b1b-f9e0-46ba-bacf-b5e0bf4d935b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.602112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:43.622473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.623147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.623423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.623693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.668515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:43.693596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.695084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8748b1-7d01-436e-91f3-92f4a5802ed7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.753618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:43.798924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 123/246] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:43.804365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.944679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebceccd-76c0-4e9d-aa1b-755ac2cfb439 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.944856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7ab8d-574a-4876-a37f-59276feece19 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:43.944936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebceccd-76c0-4e9d-aa1b-755ac2cfb439 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.945158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebceccd-76c0-4e9d-aa1b-755ac2cfb439 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.946618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 124/247] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:43.952760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.953060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.953309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.982400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:43.983060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:43.983355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:43.983631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:43.986502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:43.986502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:43.987831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:43.987940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 124/248] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:43 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:43.988889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:43.989941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:44.009391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:44.083282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 125/249] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:44.084142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.119823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baa67d-7eaa-49ca-aeb9-b9a727203197 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.162541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.163203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.163478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.163790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.175281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:44.180246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:44.181233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:44.182024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:44.187327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.219584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:44.231420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53bbc-47e3-4ab2-b313-9b606b9a785b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.297952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.298566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.298841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.299368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.300113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=53447a9836e14e32b7334a3210173cb5) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:44.300419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:44.301862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:44.323527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 126/251] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/role_assignments?user.id=53447a9836e14e32b7334a3210173cb5&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=af95450dde3449548e4b314b8bef159a => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:44.326581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:44.359667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869c6a5-f3b9-4d73-99d6-a437a851291c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.412765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.413424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.413666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.413937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.414674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:44.414976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:44.416502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:44.433303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 126/252] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:44.433483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.440714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.618826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915b1b7-b5ba-4433-a823-45b8f9005f0f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.641217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ffd27-c25c-4c1c-99b1-556271acc3f9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.652767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.653601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.654548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.655006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] PATH_INFO: `/v3/users/242c02b7359f4d79bd6a0c10dac19397` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.661311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] RBAC: Authorizing `identity:get_user(user_id=242c02b7359f4d79bd6a0c10dac19397)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:44.662930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7282e-4f55-4d9b-90ba-8d2603117df4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:44.666600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 127/253] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/users/242c02b7359f4d79bd6a0c10dac19397 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:44.668816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bdfc2-c92b-4b80-ac07-9f258edc24d5 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.670693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bdfc2-c92b-4b80-ac07-9f258edc24d5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.671651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bdfc2-c92b-4b80-ac07-9f258edc24d5 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.673028 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 128/254] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:44.674030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bdfc2-c92b-4b80-ac07-9f258edc24d5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.702105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:44.719701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.720345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.720622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.720890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.737903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-db7d6ad9-5d8e-4ef3-9b26-2d4c903b41ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:44.744900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:44.745794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:44.746574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 127/255] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:44.747268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.748611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.748611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.781083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:44.784229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:44.805596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:44.882564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bdfc2-c92b-4b80-ac07-9f258edc24d5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:44.915418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 128/256] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:44.916320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:44.956784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:44.957490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:44.957772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:44.958086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:44.959807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:44.962557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:44.964231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 129/257] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:44.971508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.094382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c8771-fc69-4fb0-a9be-c264b394ac36 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.147670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.148220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.148502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.148774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.149444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:45.149746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:45.151155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:45.163538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 129/258] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:45.170359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.181062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:45.189117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:45.284997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289d202-b835-4192-882e-8efe892dab3e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.315273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04936ec-750e-42cc-9042-a04932af0338 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.356208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.357753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.357891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.358052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.361093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:45.362630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:45.365642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 130/259] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:45.370440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.403145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.403757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.404565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.404841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/users/242c02b7359f4d79bd6a0c10dac19397/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.406750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, user_id=242c02b7359f4d79bd6a0c10dac19397, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:45.416336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:45.450065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 130/260] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:44 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/users/242c02b7359f4d79bd6a0c10dac19397/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:45.496816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18b4f4-f02b-432a-8fd3-ffb86d7ee83b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.500057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:45.535550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.536183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.536514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.536786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.599607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.616952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:45.618547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:45.726132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:45.761040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 131/261] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:45.770069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.818519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20740-f0d7-4bd6-9f7c-47b8afdc449a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.869820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.870868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.871451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.871926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.877616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:45.889778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b84c0-8d71-41eb-aba8-7af27898e322 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:45.898072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:45.904624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:45.905490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 13:59:45.906380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:45.909133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 131/262] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:45.914437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.926402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:45.927049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:45.927334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:45.927607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:45.928737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:45.935506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:45.935506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 132/263] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:45.938624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:45.985335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:46.045896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1e8e-1e06-428a-9013-8e61c4ff5b71 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:46.065172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d78d74-5f19-4d8d-b91f-4017f2408fa0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:46.083522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:46.084141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.084421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.084692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.085532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=b5e77901158b4e47bd680f9d1c00b7df) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:46.085852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:46.087403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:46.096922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 133/264] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/role_assignments?user.id=b5e77901158b4e47bd680f9d1c00b7df&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=22655a77c5404228b6c11450a3edffc1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:46.123457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:46.124472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.124981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.125482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.126393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:46.126920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:46.128618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:46.143634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 132/265] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:46.149467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:46.266650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c6f0b-e5f0-4323-944e-122ae22d4c97 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:46.274273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:46.302704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:46.303377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.303663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.303935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] PATH_INFO: `/v3/users/b5e77901158b4e47bd680f9d1c00b7df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.305081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e77901158b4e47bd680f9d1c00b7df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:46.306581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:46.308619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 134/266] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:46 2022] GET /identity/v3/users/b5e77901158b4e47bd680f9d1c00b7df => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:46.316712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:46.408442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:46.457691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103ea97-01a2-43f6-9254-38522538e4ac None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:46.498597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:46.499244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.499525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.499799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.580960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:46.582389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa0c18-e548-4c32-973e-2f9c28e4c8b2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:46.643411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:46.688774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 133/267] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:46.694453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:46.835472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79cd49-61e1-4cf4-81ca-53d04e490ca1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:46.847938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e44b7-eca6-4154-9b74-d1b5241f6ce6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.848267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e44b7-eca6-4154-9b74-d1b5241f6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.848745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e44b7-eca6-4154-9b74-d1b5241f6ce6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.851635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 134/268] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:46.860625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b9a-0b9e-406a-abc4-153b9fb7e26b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.860947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b9a-0b9e-406a-abc4-153b9fb7e26b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.861183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b9a-0b9e-406a-abc4-153b9fb7e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.886557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:46.887646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:46.888128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:46.889238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:46.891770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:46.893503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:46.895824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 135/269] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:46 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:46.897144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8ad44b9a-0b9e-406a-abc4-153b9fb7e26b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:46.898547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ad44b9a-0b9e-406a-abc4-153b9fb7e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:46.901058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:46.985014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:47.020824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:47.022071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d06c-089e-4107-b911-a8fc87522759 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.022353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d06c-089e-4107-b911-a8fc87522759 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.022620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d06c-089e-4107-b911-a8fc87522759 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.023908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 136/271] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:47.029333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbca67-2374-4613-8e91-004f29ce186d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.029842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbca67-2374-4613-8e91-004f29ce186d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.029946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbca67-2374-4613-8e91-004f29ce186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.049015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-24fbca67-2374-4613-8e91-004f29ce186d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:47.050197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-24fbca67-2374-4613-8e91-004f29ce186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:47.051654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c435-e98e-4d61-8f84-85f4a7d73fc4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.086977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.087912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.088413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.088882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.089806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=b5e77901158b4e47bd680f9d1c00b7df) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:47.090309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:47.092019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:47.098457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 136/272] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:46 2022] GET /identity/v3/role_assignments?user.id=b5e77901158b4e47bd680f9d1c00b7df&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:47.141871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 137/273] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:47.340506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.399611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce083b-ffca-4a7e-8372-a7471a506d96 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.399956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce083b-ffca-4a7e-8372-a7471a506d96 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.400164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce083b-ffca-4a7e-8372-a7471a506d96 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.401977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 138/274] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:47.408980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.409336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.409590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.433159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:47.434508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:47.449672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:47.455445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad3e6-8184-480f-b08c-c1c1f0dd2c6b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.462910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:47.492405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.493382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.493859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.494349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.505760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:47.511250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:47.512143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:47.512927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 137/275] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:47.518444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.531812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 139/276] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:47.533807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.636905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35f109-9a95-4b2d-b533-c23416b73534 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.659766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7c6c5-06c5-4f55-bf29-d347465be560 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.676289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.677240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.677667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.678068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.679302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:47.680901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:47.682754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 138/277] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:47.688441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.711245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.712129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.713087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.713538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.714661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:47.715160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:47.718197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:47.726285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:47.729793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 140/278] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:47.737165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.751888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:47.820565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1b2f-7d16-406a-b428-835729cfec6c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.844308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b131-1924-4af2-875b-7b842b4a5142 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:47.856123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.856727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.857066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.857333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.857977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:47.859453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:47.881239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:47.883147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 139/279] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 13:59:47 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:47.883147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:47.883730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:47.884079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:47.884361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] PATH_INFO: `/v3/users/93bed29845b647f8ac37371b1a62c70e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:47.901903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] RBAC: Authorizing `identity:get_user(user_id=93bed29845b647f8ac37371b1a62c70e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:47.903622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:47.905853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/users/93bed29845b647f8ac37371b1a62c70e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:47.911887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:48.004776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:48.014178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:48.027351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fea2b-057d-425b-8d62-847779b0d8ba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.048796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4a9f-0798-477a-be21-3eda1e786e18 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.066920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.067950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.068381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.069528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.081686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:48.086320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:48.086802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:48.087694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:48.088862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:48.089724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.089724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.089724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.089895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 140/281] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:48.089959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, user.id=93bed29845b647f8ac37371b1a62c70e, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:48.089959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:48.090086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:48.094292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:48.099832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 142/282] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 12 13:59:47 2022] GET /identity/v3/role_assignments?user.id=93bed29845b647f8ac37371b1a62c70e&scope.system=all&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:48.211172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad123a9-79db-4e7a-9ab2-43f6fe155d14 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.257394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.258022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.258297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.258568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.259307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:48.259608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:48.261042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad707b5-50d6-4529-b4e8-dbb1c0235047 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:48.271979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 141/283] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:48.279805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:48.404553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67006-0fcc-451a-a901-721d904947d0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.436198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44fcb5-88b7-4f7c-86a1-d3a247112ad2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.436502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44fcb5-88b7-4f7c-86a1-d3a247112ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.436819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:48.437788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44fcb5-88b7-4f7c-86a1-d3a247112ad2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.439608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 142/284] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 13:59:48.443269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.443927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.444207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.444485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] PATH_INFO: `/v3/users/53447a9836e14e32b7334a3210173cb5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.447964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] RBAC: Authorizing `identity:get_user(user_id=53447a9836e14e32b7334a3210173cb5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:48.449449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:48.452450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 143/285] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:48 2022] GET /identity/v3/users/53447a9836e14e32b7334a3210173cb5 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:48.456492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.457075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.457421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.457997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:48.504127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:48.505530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:48.519693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:48.590001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f37a2-9bcd-4f44-9f14-417887975315 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.646736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 143/286] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:48.652232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.652868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.653145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.653439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.655121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:48.656569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:48.658451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 144/287] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:48 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:48.664045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:48.766135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db24b4-a20a-4ad8-96ed-d888e12a51db None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:48.800920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:48.801577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:48.801855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:48.802126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/users/53447a9836e14e32b7334a3210173cb5/roles/af95450dde3449548e4b314b8bef159a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:48.804057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, user_id=53447a9836e14e32b7334a3210173cb5, role_id=af95450dde3449548e4b314b8bef159a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:48.805480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:48.833275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 144/288] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 13:59:48 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/users/53447a9836e14e32b7334a3210173cb5/roles/af95450dde3449548e4b314b8bef159a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 13:59:49.168270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:49.242233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:49.280573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0777bb-330c-477c-9981-8556a123051a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:49.323214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:49.323908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:49.324195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:49.324472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:49.343906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:49.348836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:49.349689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:49.351065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 145/289] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:49.355786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:49.361594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:49.495741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec8e1-a3a2-43d6-b765-149db4a66a85 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:49.539739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:49.540356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:49.540637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:49.540912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:49.541585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:49.541884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:49.543272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:49.552076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 145/290] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:49.557726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:49.699253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168d422-c78c-42fe-95ed-e32c697a4c64 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:49.728496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:49.738363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:49.739003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:49.739313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:49.739586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] PATH_INFO: `/v3/users/242c02b7359f4d79bd6a0c10dac19397` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:49.740722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] RBAC: Authorizing `identity:get_user(user_id=242c02b7359f4d79bd6a0c10dac19397)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:49.742178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:49.744185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 146/291] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:49 2022] GET /identity/v3/users/242c02b7359f4d79bd6a0c10dac19397 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:49.749531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:49.860026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:49.900443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ead8-aaf6-4d13-a891-ad2792e9c06d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:49.944262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:49.945198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:49.945678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:49.946169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.030538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:50.032051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:50.092904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:50.155020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 146/292] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:50.160894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:50.305999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcf59-b742-4776-b2fc-dce00b275658 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:50.357161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:50.357806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.358090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.358362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.359539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:50.360984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe0db-1511-4703-9014-9c3f36b4b8f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:50.362610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 147/293] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:50 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:50.368898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:50.481503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7bbf-7cb3-48c1-8f53-216cc8d8b694 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:50.522491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:50.523472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.523947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.524447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.525365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=242c02b7359f4d79bd6a0c10dac19397) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:50.525864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:50.527524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2521751-a117-4df2-bd21-b34bdf788bac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:50.534449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 147/294] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:50 2022] GET /identity/v3/role_assignments?user.id=242c02b7359f4d79bd6a0c10dac19397&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:50.704418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afad6-e33a-4343-a411-367141f51dd8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.704908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afad6-e33a-4343-a411-367141f51dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.704908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afad6-e33a-4343-a411-367141f51dd8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.706615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 148/295] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:50.712287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bd20-2574-4329-bce1-3749622d0b04 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.712580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bd20-2574-4329-bce1-3749622d0b04 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.712842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bd20-2574-4329-bce1-3749622d0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.736817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d141bd20-2574-4329-bce1-3749622d0b04 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:50.738024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d141bd20-2574-4329-bce1-3749622d0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:50.773038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:50.782726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432322f0-7ffa-416b-a2b2-a75ac12e1e8c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.783389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432322f0-7ffa-416b-a2b2-a75ac12e1e8c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.784013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432322f0-7ffa-416b-a2b2-a75ac12e1e8c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.785868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 149/296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:50.791442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.791991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.792498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.811681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:50.813220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:50.841907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 148/297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:50.848851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252a53-1618-4a8a-8b4f-71e4390d3dcd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.849369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252a53-1618-4a8a-8b4f-71e4390d3dcd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.849817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252a53-1618-4a8a-8b4f-71e4390d3dcd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.851514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 149/298] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:50.858759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:50.859320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:50.859770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:50.883107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:50.893909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:50.895130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:50.899253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 150/299] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:50.979459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 150/300] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:51.146998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.257259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd38046-51fe-4aae-aebd-45bb089963cc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.262298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.296407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.297208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.297317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.297572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.308153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:51.312952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:51.313831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 151/301] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:51.315259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.365045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.377255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.381777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31cb8a-3912-446e-be17-72220a45749a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.419773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.420408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.420684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.420952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.422038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:51.423541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:51.424043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e34b-b792-45ba-a359-f288defa9829 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.427081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:51.427081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.464424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.465056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.465331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.465597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.476267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:51.481180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:51.482645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 152/303] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:51.488343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.546318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183049b-0b15-48a9-9b41-fa6735137377 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.589660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.591789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.592101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.592582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.593737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:51.594046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:51.595501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:51.599893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14dd31-9f21-4c2c-9889-5ccbdc96b4eb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.604999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:51.610617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.619217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.632717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.644192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.644804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.645080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.645346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.646000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:51.647475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:51.675062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 153/305] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Sep 12 13:59:51 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:51.675062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.744769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74554-d176-4f3d-a441-2792fb92659f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.785615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed5e2-fecd-4b54-a75a-fd8aba70850f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:51.789095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.789721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.790002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.790274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.790952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:51.791289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:51.792692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757dcc-b31d-4131-a849-d4ce6ea6473d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:51.802707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 153/306] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:51.803945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720999-9761-48ac-9825-515b3d872229 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.804393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720999-9761-48ac-9825-515b3d872229 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.804838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720999-9761-48ac-9825-515b3d872229 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.806472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 154/307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:51.816573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.816873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.817165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.824051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:51.825723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:51.826009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:51.826285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] PATH_INFO: `/v3/users/74948347a5fb4947988ced8f9b29e44f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:51.836352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:51.837557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:51.842841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=74948347a5fb4947988ced8f9b29e44f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:51.844350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:51.846199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 154/308] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/users/74948347a5fb4947988ced8f9b29e44f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:51.851553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.886964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.918651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 155/309] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:51.920103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:51.932425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:51.973239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948f97-0224-4360-aa7a-ba2963d5f6c1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.022676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.023898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.024362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.024989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] PATH_INFO: `/v3/users/93bed29845b647f8ac37371b1a62c70e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.026964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] RBAC: Authorizing `identity:get_user(user_id=93bed29845b647f8ac37371b1a62c70e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.028457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925429-2b2d-4d14-b71d-dc67afdbcf98 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.029468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.037359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 155/310] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/users/93bed29845b647f8ac37371b1a62c70e => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:52.039310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:52.068588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.069326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.069599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.069968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.070773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, user.id=74948347a5fb4947988ced8f9b29e44f, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:52.071183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.073006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.079635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 156/311] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 12 13:59:51 2022] GET /identity/v3/role_assignments?user.id=74948347a5fb4947988ced8f9b29e44f&scope.system=all&role.id=af95450dde3449548e4b314b8bef159a => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:52.156371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:52.160138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8bb27-1a21-4872-b36b-3c7a1d772be0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.204544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.205227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.205509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.205785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] PATH_INFO: `/v3/system/users/93bed29845b647f8ac37371b1a62c70e/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.207377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93bed29845b647f8ac37371b1a62c70e, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.208815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.219824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:52.223009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 156/312] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Sep 12 13:59:52 2022] PUT /identity/v3/system/users/93bed29845b647f8ac37371b1a62c70e/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 13:59:52.318765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:52.347534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15cabb-b998-4702-bef3-69b563d443c8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.389684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.390338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.390615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.390885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.402587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:52.407643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:52.408510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:52.409296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 157/313] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:52.415727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:52.521646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f503e-e8e6-4337-b5aa-127745459887 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.557193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.557804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.558133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.558406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.559092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:52.559398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.562330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.570833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 157/314] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:52.576376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:52.694753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3265-fa41-49b3-8db8-47da32974daf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.731251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.732455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.732738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.733009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] PATH_INFO: `/v3/users/53447a9836e14e32b7334a3210173cb5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.734182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] RBAC: Authorizing `identity:get_user(user_id=53447a9836e14e32b7334a3210173cb5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.735656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.737589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 158/315] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:52 2022] GET /identity/v3/users/53447a9836e14e32b7334a3210173cb5 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:52.743186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:52.776420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:52.859504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122adeb1-834c-49aa-ac17-1b021dc0bcf9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:52.893577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:52.894197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:52.894478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:52.894754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:52.968934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:52.970787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:52.999392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:53.076277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 158/316] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 13:59:53.082111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:53.085625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:53.205370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a602-70ae-465f-a75b-c86e80a22624 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:53.244295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:53.245297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:53.245779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:53.246269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:53.248254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:53.249895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bdf56-ca73-42bb-80e6-48ea8a0e2b1f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:53.252403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 159/317] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:53 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:53.257723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:53.357638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23923c-3b7d-4ce9-9670-f6d8b4a95a98 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:53.384254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:53.393592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:53.394204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:53.394483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:53.394755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:53.395518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, scope.project.id=987c4c9b657e422183b552e949edd803, user.id=53447a9836e14e32b7334a3210173cb5) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:53.395825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:53.397269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae732-f7ea-4d5b-b52a-91c04edaedc3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:53.403382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 159/318] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 13:59:53 2022] GET /identity/v3/role_assignments?user.id=53447a9836e14e32b7334a3210173cb5&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=af95450dde3449548e4b314b8bef159a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:54.081317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab366c9f-1e64-40da-8f96-0c2314b8331c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.081718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab366c9f-1e64-40da-8f96-0c2314b8331c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.081999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab366c9f-1e64-40da-8f96-0c2314b8331c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.083534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 160/319] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:54.088607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d32d7-fb80-4cc8-b0bb-95bda46374fa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.089013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d32d7-fb80-4cc8-b0bb-95bda46374fa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.089212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d32d7-fb80-4cc8-b0bb-95bda46374fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.110125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-317d32d7-fb80-4cc8-b0bb-95bda46374fa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:54.111740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-317d32d7-fb80-4cc8-b0bb-95bda46374fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:54.184390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 160/320] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:54.298800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654cdee-c3de-4037-8f24-ff551b813077 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.299179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654cdee-c3de-4037-8f24-ff551b813077 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.299385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654cdee-c3de-4037-8f24-ff551b813077 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.300870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 161/321] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:54.306377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf0ab5-5082-43f2-b457-e04d5da970ad None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.306661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf0ab5-5082-43f2-b457-e04d5da970ad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.306932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf0ab5-5082-43f2-b457-e04d5da970ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.325234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bfbf0ab5-5082-43f2-b457-e04d5da970ad None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:54.326424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bfbf0ab5-5082-43f2-b457-e04d5da970ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:54.397102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 161/322] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:54.453548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654cdee-c3de-4037-8f24-ff551b813077 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:54.487740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e144ea-1aeb-4378-b911-1cd469dfce07 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.488022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e144ea-1aeb-4378-b911-1cd469dfce07 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.488561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e144ea-1aeb-4378-b911-1cd469dfce07 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.489939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 162/323] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 13:59:54.494943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.495446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.495901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.513799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:54.515257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:54.526688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:54.561755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654cdee-c3de-4037-8f24-ff551b813077 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:54.565272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:54.585941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 163/324] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 13:59:54.598981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:54.599849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.600274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.600692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.601931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:54.603567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:54.605269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 162/325] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 13:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:54.611305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:54.666573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:54.718784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59f93-c1af-45bc-829e-89d1f1bd94c3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:54.755996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:54.756623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.756875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.757143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.757773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:54.759275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:54.775469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 164/326] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Sep 12 13:59:54 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 13:59:54.787057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131f54-18e0-4bb8-9737-6710a7e5cf57 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:54.825435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:54.826155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:54.826440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:54.826718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:54.834857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:54.841359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:54.846580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:54.847559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:54.851987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 163/327] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 13:59:54.854236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:54.865072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:54.907746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:54.976069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f355-6a39-4cdb-a9f9-6a83f51e59d0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:54.990779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7797d-0a6a-41cd-96d3-c35ad6c69fce None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.021863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.022630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.022906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.023260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.023936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:55.024238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.025614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.035208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 165/328] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:55.036296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.036943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.037226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.037501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.042473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:55.048541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:55.054053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:55.054941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:55.055789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 164/329] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:55.061807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:55.139200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:55.174013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b93ea-24f5-4246-b35b-28c433dfb7a5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.175265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:55.195956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3447-d235-412b-a0b7-100d24af6cbe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.216407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.217063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.217621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.217621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] PATH_INFO: `/v3/users/74948347a5fb4947988ced8f9b29e44f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.221103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] RBAC: Authorizing `identity:get_user(user_id=74948347a5fb4947988ced8f9b29e44f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.221103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.222691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 166/330] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:55 2022] GET /identity/v3/users/74948347a5fb4947988ced8f9b29e44f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:55.228866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:55.248247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.252683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.266798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:55.270709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:55.367228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5463ad-dd52-4784-9e89-a629cd28ad70 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.404840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a2c59-cd3e-4537-81e4-e7e227f2d498 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.408816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.409736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.410244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.410719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] PATH_INFO: `/v3/system/users/74948347a5fb4947988ced8f9b29e44f/roles/af95450dde3449548e4b314b8bef159a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.412831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74948347a5fb4947988ced8f9b29e44f, role_id=af95450dde3449548e4b314b8bef159a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.415942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.426660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 167/332] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Sep 12 13:59:55 2022] PUT /identity/v3/system/users/74948347a5fb4947988ced8f9b29e44f/roles/af95450dde3449548e4b314b8bef159a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 13:59:55.432066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:55.450249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.451055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.451373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.451648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] PATH_INFO: `/v3/users/93bed29845b647f8ac37371b1a62c70e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.452858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] RBAC: Authorizing `identity:get_user(user_id=93bed29845b647f8ac37371b1a62c70e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.454391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd1415-91ee-4933-b4fa-64b92781e4d1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.456405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 13:59:55 2022] GET /identity/v3/users/93bed29845b647f8ac37371b1a62c70e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:55.462569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:55.515608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:55.584416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1e1e-d13c-461d-bd74-311470265027 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:55.625693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:55.626324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:55.626650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:55.626923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:55.627994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] RBAC: Adding query filter params (role.id=0e87e6c9d5914c0b801767f5bbc21ad6, user.id=93bed29845b647f8ac37371b1a62c70e, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:55.628303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:55.629848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a3751-de92-415a-aa7a-e744d542170a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:55.645866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 12 13:59:55 2022] GET /identity/v3/role_assignments?user.id=93bed29845b647f8ac37371b1a62c70e&scope.system=all&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:57.268211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85c47c-6a8c-4f51-91c6-a9fe8ae26d15 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:57.269042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85c47c-6a8c-4f51-91c6-a9fe8ae26d15 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:57.269459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85c47c-6a8c-4f51-91c6-a9fe8ae26d15 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:57.271280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:57.288946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c968-1be0-4b4d-8d57-8755fabf2f7e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:57.289842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c968-1be0-4b4d-8d57-8755fabf2f7e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:57.290334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c968-1be0-4b4d-8d57-8755fabf2f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:57.316108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e913c968-1be0-4b4d-8d57-8755fabf2f7e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:57.317314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e913c968-1be0-4b4d-8d57-8755fabf2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:57.406275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:57.648444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb07ad-d07c-4f60-982e-afd2889978b9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:57.648835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb07ad-d07c-4f60-982e-afd2889978b9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:57.649008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb07ad-d07c-4f60-982e-afd2889978b9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:57.650603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 168/337] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:57.662195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:57.662455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:57.662709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:57.687372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:57.688567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:57.710774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:57.772708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 170/338] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:57.905624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb07ad-d07c-4f60-982e-afd2889978b9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.040756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb07ad-d07c-4f60-982e-afd2889978b9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.080906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.081550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.081831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.082108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.096288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:58.101659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:58.102566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:58.103835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 169/339] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:58.110778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.131514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.229906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:58.322424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9520b-30e2-47f2-99ee-a8b20db7beee None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.325264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0cc8-23c0-4fc5-b9be-1d536a36a473 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.383452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.384493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.385000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.385474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.404437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:58.409847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:58.410713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 13:59:58.411942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 13:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:58.418526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.419094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.420250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.420532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.420803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.421483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:58.421782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:58.423195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:58.441500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:58.447017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.484155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:58.578996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f0e6d-a12c-4fd2-a46f-7885c37dfada None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.589640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:58.624695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.625399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.625680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.625950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.626616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:58.626915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:58.628659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c61c7-c437-4a65-ba37-2fb47048f31f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:58.631555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131f910-c1fc-473a-a08e-d48c18462735 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.638454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 13:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:58.639738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a524-4a8e-4d3a-a6a4-cfe2458871de None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.640123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a524-4a8e-4d3a-a6a4-cfe2458871de None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.640402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a524-4a8e-4d3a-a6a4-cfe2458871de None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.641770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 172/343] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:58.642701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dec1-016b-4209-8367-f5fa67ecf788 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.642980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dec1-016b-4209-8367-f5fa67ecf788 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.643272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dec1-016b-4209-8367-f5fa67ecf788 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.644684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 173/344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:58.646121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840dec1-016b-4209-8367-f5fa67ecf788 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:58.681093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.681865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.682287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.682563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.776204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:58.776625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840dec1-016b-4209-8367-f5fa67ecf788 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:58.777858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff874b8f-27ac-436a-a3b7-6904465f3d4b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:58.799406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:58.817586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:58.818195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.818537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.818733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.866241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:58.903954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:58.905418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726595-7446-40b5-ab00-1f1e3fdea5fe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:58.919003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 172/345] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:58.920863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:58.925944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:58.925944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:58.961866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:58.963097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:59.023002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 174/346] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 13:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 13:59:59.024310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.024612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.024845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.047268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 13:59:59.048449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 13:59:59.086307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 173/347] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:59.087365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.150239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.157621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 175/348] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 13:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 13:59:59.158269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.183073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.288273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fa71f-8851-48d7-9487-c71d8e1108f3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.296708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ab16-8fef-4fae-bd3e-c1259c3cd297 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.335614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.336995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.337477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.337946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.342811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.344530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.349239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 176/349] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:59.355048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.374222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.374920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.375324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.375494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.378828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.379466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.381550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 174/350] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:59.386891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.437390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.472127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad90ec-54e6-400d-ae30-294a1a77c6ee None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.511575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.512638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.513636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.514100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.520802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.523118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.525445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 177/351] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:59.532099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.587847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38894cb0-0141-430d-b5aa-e34b47bf3f34 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.604003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.630629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.631315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.631638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.631916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.633048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.634613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.636410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 175/352] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 13:59:59.637121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.649039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8bfd-74c6-4141-92e3-a6f5325471fb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.685009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.690986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.692123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.692622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.693092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.694027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:59.694802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.696792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.703418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 178/353] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=22655a77c5404228b6c11450a3edffc1 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:59.704565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.789943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d4ef-3c97-4b76-b994-e6f230302557 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.821807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975dba2-98cb-4a90-9d9b-d9524ce00f00 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 13:59:59.845385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.846048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.846444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.846727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.862160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 13:59:59.868153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 13:59:59.869073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ebc7def3-0aee-4ea0-ae85-fadae23e4604 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 13:59:59.869179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 13:59:59.870064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 13:59:59.870884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 176/354] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 13:59:59.872292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb081-92a6-4f10-b4e5-d394f975c5ef None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 13:59:59.872589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb081-92a6-4f10-b4e5-d394f975c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.872870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cb081-92a6-4f10-b4e5-d394f975c5ef None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.873092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 13:59:59.873553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 13:59:59.874229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 177/355] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 13:59:59.874738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 13:59:59.874965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cb081-92a6-4f10-b4e5-d394f975c5ef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.875475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 13:59:59.877264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 13:59:59.888591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 179/356] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 13:59:59.889773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 13:59:59.944947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 13:59:59.970006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.035990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8559a-f579-43db-be22-f4876904bb0f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.039161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cb081-92a6-4f10-b4e5-d394f975c5ef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.081330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.081992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.082308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.082594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.083305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:00.083636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:00.085339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81251ad-99a8-46ba-9a7e-400c337f2d8f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:00.093775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.094553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.094735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.094983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.097803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 180/357] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:00.099768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.100307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.100965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.109003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:00.114530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:00.115531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:00.116328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 178/358] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 13:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:00.117012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.129760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:00.131743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:00.227569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:00.228548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.245578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.250306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a18b-5fb8-4238-a3e6-fd25fd226187 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.291475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.296238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.296888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.297438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.297717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] PATH_INFO: `/v3/users/74948347a5fb4947988ced8f9b29e44f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.299113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] RBAC: Authorizing `identity:get_user(user_id=74948347a5fb4947988ced8f9b29e44f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:00.301209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b1d71-c8f6-47b4-aba5-e91904aad727 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:00.303711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 179/360] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/users/74948347a5fb4947988ced8f9b29e44f => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:00.304879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081c7b-d3f3-46f9-8d72-1773583fcfa4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.305163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081c7b-d3f3-46f9-8d72-1773583fcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.305435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081c7b-d3f3-46f9-8d72-1773583fcfa4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.306648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 180/361] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:00.314186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.314457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.314732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.337884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:00.339479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:00.355976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7742e-8361-44a6-bd78-6db07966813d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.395274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.395892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.396173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.396446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.397121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:00.397423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:00.398882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:00.412816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 182/362] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:00.413717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.423771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 181/363] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:00.424632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.537260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.541380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb80ddf-47fa-4496-9abd-914396be7835 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.618488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac06e-bec9-4fef-b36b-650d8fe8e481 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.627989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.628611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.628887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.629160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.640008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.662992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.663779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.664072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.664339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.665079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] RBAC: Adding query filter params (role.id=af95450dde3449548e4b314b8bef159a, user.id=74948347a5fb4947988ced8f9b29e44f, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:00.665390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:00.666821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:00.680660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/role_assignments?user.id=74948347a5fb4947988ced8f9b29e44f&scope.system=all&role.id=af95450dde3449548e4b314b8bef159a => generated 510 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:00.730287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.736667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:00.738418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:00.863082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fad6-1e6a-47df-8e91-0371d06f0988 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:00.894355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:00.901789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 182/365] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:00.909944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.923145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:00.923808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:00.924090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:00.924364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:00.945031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:00.951093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:00.952105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:00.953125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:00.953909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:00.993421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.053551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6510-4fd9-40f5-8b6f-d1eafcfcac71 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.072208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333d4-3753-4238-ae77-5bd9dd2ccbd6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.095941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.096928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.097580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.098072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.099549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.101269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.103291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.104367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.139145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.139145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.139145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.139145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.162537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:01.169607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:01.170538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:01.171376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:01.172602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.198214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.247910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32674-23f2-4d0f-b053-6b9c56674e2b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.286365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.287474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.288034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.288316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.289141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:01.289454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.289967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.291554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.300899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285cc99-f4ee-4781-83d2-5490bb6fefd3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.303269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.305117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.338025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.338657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.338938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.339253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.341466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.342880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.344932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.345830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.437806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9996d-cee2-4fda-af06-0b9e00baf3df None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.469083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d9a6-3ad5-496b-88b5-f52c8a2d465f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.476329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.489696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.490603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.491099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.491605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.493055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:01.493940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.496366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.506985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.508209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.511000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.511789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.512145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.512519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.544343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.593221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.594893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.656295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cffc-329f-47d4-98f5-3d577543a55b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.705377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.706614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.707511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.707975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.708907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=987c4c9b657e422183b552e949edd803) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:01.709399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.711954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.722049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 186/372] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.723187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.730811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:01.737258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:01.811208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.858943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:01.911340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912fa11-119f-48df-9e3c-bf589d84b4f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.937354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61710b22-6792-4cd0-b84c-e7bdea13342b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:01.964748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:01.966646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:01.967164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:01.967662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:01.969855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:01.971700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:01.973677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 188/374] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:01.980423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:02.002012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:02.002635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.002916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.003223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.117701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:02.117701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:02.130354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62079-ebd9-4dc5-8e3d-de493ca35651 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:02.179332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:02.198851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:02.199574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.199860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.200134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.204542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:02.206305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:02.207678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 189/375] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:02.214536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:02.228653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:02.321179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 187/376] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:02.328597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:02.455245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497be99-b4d2-4c9d-9110-5ff86597dae0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:02.523063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:02.523648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.523883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.524134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.524871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=987c4c9b657e422183b552e949edd803) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:02.525177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:02.526619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:02.540650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 190/377] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:02 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=22655a77c5404228b6c11450a3edffc1 => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:02.553090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeea4c-b1ab-4230-8302-248cc868c52c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:02.610545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:02.611232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.611510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.611785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] PATH_INFO: `/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.616152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f81b8c04c00483f8fd1db4c83254d3d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:02.619584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5567-d0e3-43ef-a111-ca4f193ae8e8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:02.621778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 188/378] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:02 2022] GET /identity/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d => generated 344 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:02.630679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:02.736318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:02.798879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b2a9-f156-49ed-82ef-91ce265be64a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:02.801878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86d69-e960-4902-97df-34cdb1662d82 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.802330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86d69-e960-4902-97df-34cdb1662d82 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.802760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86d69-e960-4902-97df-34cdb1662d82 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.805433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 189/379] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:02.812685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e838-177d-4443-adce-dc6887986f1b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.812980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e838-177d-4443-adce-dc6887986f1b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.813267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e838-177d-4443-adce-dc6887986f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.840329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c629e838-177d-4443-adce-dc6887986f1b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:02.842462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c629e838-177d-4443-adce-dc6887986f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:02.863558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:02.867688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:02.868656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:02.869161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:02.869434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] PATH_INFO: `/v3/groups/8f152d6c8c364452a3541e36dfd5458b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:02.875798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] RBAC: Authorizing `identity:get_group(group_id=8f152d6c8c364452a3541e36dfd5458b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:02.877175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:02.879257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 191/380] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:02 2022] GET /identity/v3/groups/8f152d6c8c364452a3541e36dfd5458b => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:02.884921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:02.928617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 190/381] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:03.016394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fad4f-a37c-4867-988e-775a81d1312c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:03.043901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:03.056209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:03.057060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.057496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.057921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.058812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] RBAC: Adding query filter params (group.id=8f152d6c8c364452a3541e36dfd5458b, role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=0f81b8c04c00483f8fd1db4c83254d3d) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:03.059304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:03.061553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ff4c9-1bb8-4e78-9fcb-2316c0623a0b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:03.068000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 192/382] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:02 2022] GET /identity/v3/role_assignments?group.id=8f152d6c8c364452a3541e36dfd5458b&scope.project.id=0f81b8c04c00483f8fd1db4c83254d3d&role.id=c0a540da48234e2db9dc1b474267f52f => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:03.163387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b262-ef9c-48b3-b59c-40ce0f20ae52 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.163934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b262-ef9c-48b3-b59c-40ce0f20ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.164376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b262-ef9c-48b3-b59c-40ce0f20ae52 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.166146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 191/383] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:03.172188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.172735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.173160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.194761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:03.201191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:03.284698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:03.316772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131b262-ef9c-48b3-b59c-40ce0f20ae52 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:03.432515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131b262-ef9c-48b3-b59c-40ce0f20ae52 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:03.475157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:03.476329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.476811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.477291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.489433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:03.494642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:03.495611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:03.496484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:03.499116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:03.505342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:03.625256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6021ed-f857-449b-a680-b04060acd2b6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:03.631727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:03.646569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:03.656992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:03.671912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:03.672595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.672880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.673153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.673831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:03.674140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:03.677555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:03.694418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:03.701197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:03.787525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c5ff-c087-476b-bd0a-72f62d94c5a4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:03.840708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:03.841930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.842211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.842548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.856084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:03.861433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:03.862556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:03.863809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:03.864578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 193/387] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:03.872394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:03.902924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9503a-f04d-4404-8af8-cfbd24e6a948 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:03.973851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:03.974750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:03.975996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:03.976645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:03.978549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:03.980332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:03.984488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 195/388] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:03.990317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:04.030921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:04.089867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986340a-87b1-4a28-bda8-a35113e04ad3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.095908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:04.156319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fede28c-7fb3-4537-a2aa-2f57826dcbd6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.165970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.166723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.166859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.167136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.167805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:04.168105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.169522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.188013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 194/389] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:04.196304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:04.202733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.203596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.204046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.204474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.206680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.208322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.215312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 196/390] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:03 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:04.224263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:04.399354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99da99c-1109-4a57-92b5-c87c58c8ff82 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.421578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3141-4b8a-4767-b251-89f5fa5ce73c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.452710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:04.470350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.470991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.471296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.471569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.473353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.474786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.476369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 195/391] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:04 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:04.482774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:04.486192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.486860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.487171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.487447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/groups/3dc67fa5db904e408d8ab2980d219935/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.487768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:04.496961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, group_id=3dc67fa5db904e408d8ab2980d219935, role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.499115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.525418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 197/392] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 12 14:00:04 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/groups/3dc67fa5db904e408d8ab2980d219935/roles/22655a77c5404228b6c11450a3edffc1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:00:04.611653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910f3-3fe3-46e2-af1d-02044f0da089 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.653220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.653879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.654163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.654477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.655625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.657260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e06e0-29aa-439b-92ae-43fc003b9524 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.663153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 196/393] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:04 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:04.665251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:04.800479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6e68-3b87-4e66-a3cd-96f459c58fd7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:04.838181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:04.838907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:04.839226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:04.839509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/groups/3dc67fa5db904e408d8ab2980d219935/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:04.841984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8e0cc3d824f0489a023c1b3276472, group_id=3dc67fa5db904e408d8ab2980d219935, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:04.843454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ef4d0-dcf5-4041-83c9-48f9235088b7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:04.862373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 198/394] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 12 14:00:04 2022] PUT /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472/groups/3dc67fa5db904e408d8ab2980d219935/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:05.045509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bac1-491c-4df9-8220-9b53d001f358 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.045873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bac1-491c-4df9-8220-9b53d001f358 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.046174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bac1-491c-4df9-8220-9b53d001f358 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.047855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 197/395] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:05.053095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b823-858a-4a0b-84a5-ec500505ff28 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.053615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b823-858a-4a0b-84a5-ec500505ff28 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.054089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b823-858a-4a0b-84a5-ec500505ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.074042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-90a2b823-858a-4a0b-84a5-ec500505ff28 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:05.076175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-90a2b823-858a-4a0b-84a5-ec500505ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:05.105874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:05.158850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 199/396] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:05.307973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23e348-a4ac-441d-b6b3-1ed38f276813 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.308156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23e348-a4ac-441d-b6b3-1ed38f276813 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.308470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23e348-a4ac-441d-b6b3-1ed38f276813 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.310096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 198/397] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:05.324737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.325886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.326379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.351900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:05.353442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:05.427774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 200/398] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:05.465008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23e348-a4ac-441d-b6b3-1ed38f276813 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:05.547120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:05.585736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23e348-a4ac-441d-b6b3-1ed38f276813 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:05.626017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:05.626664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.626946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.627247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.639468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:05.644977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:05.645861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:05.647131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 199/399] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:05.652284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:05.787707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:05.795608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bf29b-9eb1-4648-a243-743f9cc61035 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:05.803530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:05.843318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:05.843859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:05.844135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:05.844404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:05.845083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:05.845382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:05.846751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:05.862081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 201/400] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:05.872547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.006257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf29510-6d69-4423-8035-e2e97d7854df None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.007056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b3a7-5033-4a86-aadc-0c558b59864c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.045446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.052108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.052885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.053240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.053518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.069082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.070746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.071068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.071328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.072555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.074073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dba55-3922-4949-9eec-1474f6af8548 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.076547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:05 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:06.077290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:06.077634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39f33-98e2-4eae-b0ed-4923f4d026d8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.077918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39f33-98e2-4eae-b0ed-4923f4d026d8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.078194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39f33-98e2-4eae-b0ed-4923f4d026d8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.079918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 203/402] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:06.083131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:06.084037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:06.084842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:06.085460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.086050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.086050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.089779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 200/403] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:06.090688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.111441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:06.114029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:06.138360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.194508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 204/404] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:06.195422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.230232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280d8d7-0408-4ce7-930a-9532c53be34e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.269132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.269767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.270048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.270321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.271585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.273256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.275243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 201/405] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:06.281161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.303225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28783a-8de1-470a-a65c-0d5efd3f5693 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.343404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.349471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.352552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.352878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.353160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.353839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:06.354142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.355638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.365258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:06.371738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.392246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.448681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f56b5-3dce-495d-a8c6-99537918df30 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.511492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fce4-49a7-4c4d-acc4-6b4fc05e1d93 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.546603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.547261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.547583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.547805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.549159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.550635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.552021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.552365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 206/407] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:06.552707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.552987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.553103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.553258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/groups/3dc67fa5db904e408d8ab2980d219935/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.556359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, group_id=3dc67fa5db904e408d8ab2980d219935, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.558124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.579621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 202/408] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 12 14:00:06 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/groups/3dc67fa5db904e408d8ab2980d219935/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:06.581006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.691670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.707715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56288b5-d3a3-4901-abf2-87ec3619f17d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.750170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.750927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.751306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.751690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.766571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:06.772193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:06.773712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:06.775074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 207/409] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:06.786108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.825742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f7e37-fdf9-40ba-9d71-8d18745265b2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.851785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:06.884161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.884801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.885803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.886056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.888199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.889659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.891318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 203/410] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:06.903942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:06.948619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5d3e-c90e-416a-b6d8-53586dcc4ec0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:06.985448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:06.986053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:06.986329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:06.986601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:06.987295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:06.987596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:06.989827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:06.999443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 208/411] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:07.004793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:07.020738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:07.113092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5e67-b846-46f0-b902-fac25336d7a4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:07.147563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ba6ca-cdf2-447b-a979-d4e8860e3859 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:07.150764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:07.151464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.151741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.152010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803/groups/3dc67fa5db904e408d8ab2980d219935/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.154234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=987c4c9b657e422183b552e949edd803, group_id=3dc67fa5db904e408d8ab2980d219935, role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:07.155712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:07.169940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 204/412] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 12 14:00:06 2022] PUT /identity/v3/projects/987c4c9b657e422183b552e949edd803/groups/3dc67fa5db904e408d8ab2980d219935/roles/22655a77c5404228b6c11450a3edffc1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:07.219414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:07.220074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.220351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.220621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] PATH_INFO: `/v3/groups/8f152d6c8c364452a3541e36dfd5458b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.225534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] RBAC: Authorizing `identity:get_group(group_id=8f152d6c8c364452a3541e36dfd5458b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:07.227132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:07.229131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 209/413] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:07 2022] GET /identity/v3/groups/8f152d6c8c364452a3541e36dfd5458b => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:07.234655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:07.295806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:07.359089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc03a9-c479-4289-b757-bf0a84610bcf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:07.400478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:07.401452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.401946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.402472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] PATH_INFO: `/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.405069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] RBAC: Authorizing `identity:get_project(project_id=0f81b8c04c00483f8fd1db4c83254d3d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:07.406709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26929a8-4d95-4aeb-8554-347190c5c479 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:07.408721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 205/414] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:07 2022] GET /identity/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:07.414450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:07.508364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:07.538723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0232885-a7be-4478-9fc1-62304cd6232c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:07.586032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:07.587070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.587546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.588034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] PATH_INFO: `/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d/groups/8f152d6c8c364452a3541e36dfd5458b/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.592665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f81b8c04c00483f8fd1db4c83254d3d, group_id=8f152d6c8c364452a3541e36dfd5458b, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:07.594329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0727-106b-405e-9ffc-ab443b14db65 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:07.613906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cfe-6cba-43a3-8037-662b2ab44e47 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.614242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cfe-6cba-43a3-8037-662b2ab44e47 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.614645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cfe-6cba-43a3-8037-662b2ab44e47 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.616353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 206/415] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:07.622689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84c4b-f1f4-4182-bd31-3985e8af28ad None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.623511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84c4b-f1f4-4182-bd31-3985e8af28ad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.624166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84c4b-f1f4-4182-bd31-3985e8af28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.625953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 210/416] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 12 14:00:07 2022] PUT /identity/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d/groups/8f152d6c8c364452a3541e36dfd5458b/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:07.649442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-36e84c4b-f1f4-4182-bd31-3985e8af28ad None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:07.650753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-36e84c4b-f1f4-4182-bd31-3985e8af28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:07.753853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:07.849273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613204-7f0f-4063-ada9-92b0e3267597 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.849944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613204-7f0f-4063-ada9-92b0e3267597 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.850420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613204-7f0f-4063-ada9-92b0e3267597 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.852436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 211/418] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:07.858018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:07.858868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:07.859378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:07.879202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:07.880683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:07.926318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:07.963153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 208/419] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:08.081674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613204-7f0f-4063-ada9-92b0e3267597 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.224640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613204-7f0f-4063-ada9-92b0e3267597 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:08.267094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:08.267732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:08.268010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:08.268275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:08.271096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:08.282399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:08.287438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:08.288520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:08.289502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:08.292328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 212/420] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:08.297622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.301344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.475738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b35c80-8d27-4960-9844-148e09f68c74 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:08.478768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7c10-f4f7-4e7f-8d04-d9b921e5cac9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:08.530578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:08.531248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:08.531532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:08.531805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:08.543471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:08.544114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:08.544398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:08.544674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:08.545346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:08.545650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:08.547022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:08.554231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:08.559180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:08.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:08.561407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:08.561998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 209/421] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:08.568734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 213/422] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:08.569444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.574805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.640186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:08.671668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:08.754783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21035ea-0697-45a9-8dbb-b124e4e04ac1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:08.758608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffcde4-d491-48fb-9085-c7cd4b56eade None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:08.821209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:08.822699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:08.823617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:08.824399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:08.825821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:08.826625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:08.827478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:08.827986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:08.829590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:08.830080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:08.830553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:08.849420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 210/423] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:08.856502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:08.964357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:08.967377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.037067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.047786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b162-6418-43c9-9c1f-f38c0d419055 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.060213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.110383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.111818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.112309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.112772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.147148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 214/424] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:09.168411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.255580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.257065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d2aa-c7f3-403d-91b1-48cadce56e18 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.355963 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eb662-7083-4c51-8cda-311b5c6c1f4b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.395140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.396112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.396884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.397767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.399509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.400447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.402395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.405928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 215/425] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:09.411760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 211/426] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:09.411760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cbaa-c7bb-4139-8e0f-d3d176a24ff6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.411760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cbaa-c7bb-4139-8e0f-d3d176a24ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.411760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cbaa-c7bb-4139-8e0f-d3d176a24ff6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.411760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 212/427] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:09.412226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64cbaa-c7bb-4139-8e0f-d3d176a24ff6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.416732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.446191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.524726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde10b6-fcb5-4258-b22f-2420a6ec34ec None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.560643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64cbaa-c7bb-4139-8e0f-d3d176a24ff6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.562233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.563178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.563651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.564115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] PATH_INFO: `/v3/projects/b3f8e0cc3d824f0489a023c1b3276472` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.565449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f8e0cc3d824f0489a023c1b3276472)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.567112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aea6e-55ef-4318-84a6-8d8f4d452bb8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.573569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 216/428] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/projects/b3f8e0cc3d824f0489a023c1b3276472 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:09.575106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.575647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.576128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.595296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:09.596794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:09.600885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.601610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.601963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.602310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.603549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.605087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.612745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:09.612745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.678731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 217/430] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:09.680035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.702627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.729262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:09.774196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd72e-a177-4f57-8476-5bd531133066 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.813665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.814336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.814617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.814891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.816085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.817553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eaf6f-2072-4b25-af5a-c7c790281896 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.819130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:09.820235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94011-f160-45d3-a2e5-f9972917723c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.820513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94011-f160-45d3-a2e5-f9972917723c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.820884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94011-f160-45d3-a2e5-f9972917723c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.827211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 215/432] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:09.828070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94011-f160-45d3-a2e5-f9972917723c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:09.841587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce745e-1835-4c4f-b4c8-307b9161a31d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:09.879567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:09.880140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.880420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.880690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.881488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:09.881788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:09.883242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1a99-2201-4694-9790-e417f1312f0a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:09.889827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 218/433] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:09.890983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:09.895442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:09.895916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:09.940183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:09.941428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:09.990866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94011-f160-45d3-a2e5-f9972917723c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.038209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.048493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.049501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.049974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.050542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.051527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=b3f8e0cc3d824f0489a023c1b3276472) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:10.051991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 219/434] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:10.052283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:10.052970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.054392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94235950-99e4-4b50-ad07-b40c1e2c88c9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:10.069718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 216/435] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:09 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=b3f8e0cc3d824f0489a023c1b3276472&role.id=22655a77c5404228b6c11450a3edffc1 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:10.071082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162736fc-8e87-4589-990d-78d8f0fe6bb7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.071371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162736fc-8e87-4589-990d-78d8f0fe6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.071643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162736fc-8e87-4589-990d-78d8f0fe6bb7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.073007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 217/436] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:10.080385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.080732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.080922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.091805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.127785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:10.127785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:10.223587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064670ef-0454-44ae-938f-bf5ed474032e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.225062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 218/437] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:10.269347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.270350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.270852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.271338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.283656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:10.288995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:10.289877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 14:00:10.290652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:10.292970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 220/438] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:10.299413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.342858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.436042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0754-cec7-4b59-897b-7c5f597e526e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.445723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.470561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.471982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc1-b70f-4903-8b42-4eb7c22f1e2a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.491349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.492471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.492929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.493505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.494658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:10.495170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:10.497765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:10.513593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 219/439] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:10.514164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.514164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.514340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.514575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.518087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.535463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:10.544676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:10.545582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:10.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:10.547236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 221/440] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:10.551064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.644129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eba52-b554-4817-8279-702d4a6a3271 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.665282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69fbbd-b74e-45c4-9855-93ec3c7cf831 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.684597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.685428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.685542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.685738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.708691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.709319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.709599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.709862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.719946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.728095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:10.733864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:10.734755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:10.736151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:10.739619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.750769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.763894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:10.765355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:10.840737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ce43-910e-4528-9475-b8823f67448e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.867405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 220/442] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:10.868347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.878092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:10.878092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:10.879146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:10.879242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:10.879899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:10.880197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:10.881561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:10.890144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 223/443] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:10.890936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:10.950001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.956295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:10.969197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251a97-bd49-453f-a492-5e1bf87dd1f0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:10.992678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73212a0-c910-40d9-80b3-066b653f3938 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.002368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.002982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.003346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.003623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.004275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:11.004573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.005960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.014262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 221/444] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.015047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.026926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.027574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.027851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.028140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.029310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.030753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.032458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 224/445] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:10 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.035845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.116367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71859bac-4ed0-4c7b-9157-708249636f6b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.136355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea544e-d824-4e59-b89a-3649fe9466f9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.151517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.152128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.152400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.152666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.164280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.172220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.173839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.174426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.174698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.174969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.220735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.222205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.241734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.243199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.319397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 222/446] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:11.320148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.345098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 225/447] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:11.345914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.372011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.373050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.421781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c963-8cbc-4c79-b94b-b35478e70561 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.442810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a43d-4201-40ea-bff6-3bec9d72a705 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.455387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.456030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.456313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.456591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.457744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.459244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.460853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 223/448] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.461614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.478966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.480295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.480436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.480724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] PATH_INFO: `/v3/projects/987c4c9b657e422183b552e949edd803` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.482344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] RBAC: Authorizing `identity:get_project(project_id=987c4c9b657e422183b552e949edd803)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.483811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.485575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 226/449] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/projects/987c4c9b657e422183b552e949edd803 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.486255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.562341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490f861-f4ae-48a0-8a6e-bd6129523784 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.578875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.579010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.585046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8789c8-6b30-4adb-baa0-1bfc805dea12 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.596227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.596863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.597137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.597415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] PATH_INFO: `/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.598517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] RBAC: Authorizing `identity:get_project(project_id=0f81b8c04c00483f8fd1db4c83254d3d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.599984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.601584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 224/450] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/projects/0f81b8c04c00483f8fd1db4c83254d3d => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.602326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.621361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.622008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.622290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.622565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.623330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=0e87e6c9d5914c0b801767f5bbc21ad6, scope.project.id=987c4c9b657e422183b552e949edd803) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:11.623645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.625054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.635065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 227/451] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=0e87e6c9d5914c0b801767f5bbc21ad6 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.635065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.718550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5bb9-ed02-406b-b398-a3d45088dbaa None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.748304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a7b4c-ac7f-48b2-82c5-40430324c295 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.755696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.756362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.756639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.756914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] PATH_INFO: `/v3/groups/3dc67fa5db904e408d8ab2980d219935` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.758136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] RBAC: Authorizing `identity:get_group(group_id=3dc67fa5db904e408d8ab2980d219935)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.759672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.761677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 225/452] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/groups/3dc67fa5db904e408d8ab2980d219935 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.767313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.789766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.790420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.790708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.790983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] PATH_INFO: `/v3/groups/8f152d6c8c364452a3541e36dfd5458b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.792179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] RBAC: Authorizing `identity:get_group(group_id=8f152d6c8c364452a3541e36dfd5458b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.793627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.795922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 228/453] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/groups/8f152d6c8c364452a3541e36dfd5458b => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:11.802185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:11.833598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.839438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:11.888878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d565-4751-4859-8beb-a623d700dbf8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.928931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.929539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.929814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.930081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.930433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cef98e-3627-4572-b282-0a81883c6c6c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:11.930807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] RBAC: Adding query filter params (group.id=3dc67fa5db904e408d8ab2980d219935, role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=987c4c9b657e422183b552e949edd803) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:11.931146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.932590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ee50d-0350-4a32-b162-e98bdbba03ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.939015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 226/454] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/role_assignments?group.id=3dc67fa5db904e408d8ab2980d219935&scope.project.id=987c4c9b657e422183b552e949edd803&role.id=22655a77c5404228b6c11450a3edffc1 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:11.971964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:11.972589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:11.972888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:11.974000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:11.974000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] RBAC: Adding query filter params (group.id=8f152d6c8c364452a3541e36dfd5458b, role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=0f81b8c04c00483f8fd1db4c83254d3d) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:11.974220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:11.975730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bd008-bdcd-48e0-ba0b-d450e4ad28e1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:11.983313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 229/455] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 12 14:00:11 2022] GET /identity/v3/role_assignments?group.id=8f152d6c8c364452a3541e36dfd5458b&scope.project.id=0f81b8c04c00483f8fd1db4c83254d3d&role.id=c0a540da48234e2db9dc1b474267f52f => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:14.567273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387f6a-f2f9-44c7-b9cf-4af5b6d01169 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:14.567789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387f6a-f2f9-44c7-b9cf-4af5b6d01169 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:14.567789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad387f6a-f2f9-44c7-b9cf-4af5b6d01169 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:14.569354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 227/456] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:14.574850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423b1e-3d95-4cbc-8853-4d05c9c03e33 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:14.576273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423b1e-3d95-4cbc-8853-4d05c9c03e33 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:14.576742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423b1e-3d95-4cbc-8853-4d05c9c03e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:14.599046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e0423b1e-3d95-4cbc-8853-4d05c9c03e33 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:14.600554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e0423b1e-3d95-4cbc-8853-4d05c9c03e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:14.690532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 230/457] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:15.033906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad387f6a-f2f9-44c7-b9cf-4af5b6d01169 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.097833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0443d-cf91-4c1b-9457-765d93a23bfb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.098451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0443d-cf91-4c1b-9457-765d93a23bfb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.098917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0443d-cf91-4c1b-9457-765d93a23bfb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.100729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 231/458] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:15.108960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b5e0-1c06-417f-8309-f587b368c1d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.108960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b5e0-1c06-417f-8309-f587b368c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.108960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b5e0-1c06-417f-8309-f587b368c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.144915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0001b5e0-1c06-417f-8309-f587b368c1d5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:15.148347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0001b5e0-1c06-417f-8309-f587b368c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:15.189703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:15.208706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad387f6a-f2f9-44c7-b9cf-4af5b6d01169 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:15.254317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:15.281918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:15.282941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.283451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.283974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.286467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:15.291789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb05c-dfdf-4b9f-a40b-d3e431c098ef None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.292146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb05c-dfdf-4b9f-a40b-d3e431c098ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.292497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb05c-dfdf-4b9f-a40b-d3e431c098ef None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.298361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 233/460] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:15.300719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:15.301097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf2cb-b609-4e4d-9a38-ccf7a2912b99 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.301448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf2cb-b609-4e4d-9a38-ccf7a2912b99 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.301791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf2cb-b609-4e4d-9a38-ccf7a2912b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.302962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:15.322543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-11ddf2cb-b609-4e4d-9a38-ccf7a2912b99 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:15.323845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-11ddf2cb-b609-4e4d-9a38-ccf7a2912b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:15.326112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:15.326986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:15.327872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:15.327872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:15.327872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:15.329437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 228/461] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:15.335508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.394040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:15.395579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fa9f-43d6-485c-b023-bda14c1abedf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.395959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fa9f-43d6-485c-b023-bda14c1abedf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.396329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fa9f-43d6-485c-b023-bda14c1abedf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.397928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 235/463] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:15.403568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.403959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.404340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.423304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:15.424471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:15.493860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 236/464] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:15.509737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db736b5e-1692-4b7c-b80f-2a1430d3cd70 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:15.566467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:15.567008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.567315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.567864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.568210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:15.568510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:15.569877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:15.587967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 229/465] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:15.594143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.614501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:15.656186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.703369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:15.771927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2c53-fdad-4fae-8713-ddf8ea91d5c8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:15.804149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bcc2c-ef7a-4d5b-a16b-5d739572928f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:15.813089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:15.814053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.814332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.814601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.815585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:15.817064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:15.838710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 237/466] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:15 2022] POST /identity/v3/users => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:15.839557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.846982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:15.848037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:15.848549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:15.849040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:15.870050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:15.873043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:15.896136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:15.897366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:15.898424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:15.898424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:15.898424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:15.900626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 230/467] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:15.902558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:15.930163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:15.971132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245182-4ac0-4a1f-9cbf-f355afc2a66a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.013035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.013035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.013404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.013775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.025784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.027517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.027926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:16.043438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:16.044591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:16.045650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:16.045650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:16.045650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:16.046702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 238/468] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:16.048368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.053369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02af2-5588-47af-8703-b0f9d9acb89b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.091582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.092437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.092895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.093164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.112371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.114138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:16.133349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:16.134328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:16.135212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:16.135212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:16.135212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:16.135212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 231/469] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:16.135425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.182394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad38b0-7515-459f-af6a-f4e926928c33 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.208888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:16.225388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.226421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.226897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.227408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.228251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:16.229026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.231449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.253244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a3a7-a3bc-44cd-a9cd-2db95dbbe02d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.256710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 239/470] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:16.262123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.291496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.292108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.292425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.292693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.293330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:16.293671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.295079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.296533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:16.308420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 232/471] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:16.309163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.385591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfbfb8-34f3-4112-a56c-a5e2562b344a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.411926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48dc71-6290-4829-9c28-4dc968e0b2cf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.424041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.424651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.424931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.425204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.425851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:16.426155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.427571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a7ffc-343c-4cb8-af35-00e2014a190b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.444377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 240/472] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:16.444377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615823-878f-4cb3-aced-1024eba1ba47 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.444377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615823-878f-4cb3-aced-1024eba1ba47 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.444377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615823-878f-4cb3-aced-1024eba1ba47 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.447615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 241/473] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:16.448123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615823-878f-4cb3-aced-1024eba1ba47 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.453037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.453724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.454072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.454412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.455171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.456696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.487062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 233/474] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:16 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:16.487062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:16.511812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:16.554214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:16.599275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615823-878f-4cb3-aced-1024eba1ba47 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.618987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de8a81-650e-4d96-adf8-c4dd9ef28b7a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:16.645681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.646663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.646961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.647274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.647946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.649416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf427d67-54d7-41bc-bd57-0bb440ca270e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.669536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:16.669926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.670097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.670373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.671061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:16.672579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:16.686000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 242/475] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:16 2022] POST /identity/v3/users => generated 249 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:16.687687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:16.688149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:16.688635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:16.709214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 234/476] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:16 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:16.712019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:16.713687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:16.812917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 243/477] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:17.097782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:17.211733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aeeef-e289-4325-9729-1a5bbbe97f54 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:17.219579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:17.251799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:17.252421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:17.252706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:17.252984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:17.253678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:17.255138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:17.274277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.sql.core [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 14:00:17.274277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 14:00:17.274277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [parameters: {'id': '3ee2bd5bf6714152a89aba408b7c124e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 14:00:17.274277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81611) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 12 14:00:17.291062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return ref.to_dict() Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:00:17.292080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application yield resource Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise self.value Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application session.commit() Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 14:00:17.292984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.flush() Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application compat.raise_( Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 14:00:17.293924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:00:17.294780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:00:17.297259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [parameters: {'id': '3ee2bd5bf6714152a89aba408b7c124e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:17.299230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 14:00:17.301172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:17.304184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 235/478] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 12 14:00:17 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:17.314573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:17.341084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:17.440889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b539-efd4-440b-96b6-3dd5a2c9b131 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:17.487705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:17.488930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:17.489413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:17.489888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:17.503876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bd797e9a-39ae-48be-a661-ee2e7cd12de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:17.509089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:17.509974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 14:00:17.510778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:17.513585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 244/479] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:17.519640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:17.655855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c799-8004-49ee-9508-5183f97479e7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:17.695908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:17.696501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:17.696782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:17.697048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:17.697714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:17.698013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:17.699408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15905e-780b-49b9-8edd-761bc0041939 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:17.710264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 236/480] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:18.426330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39e9f-77b1-4993-9841-1b42e3c3d4cb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:18.426823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39e9f-77b1-4993-9841-1b42e3c3d4cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:18.426823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39e9f-77b1-4993-9841-1b42e3c3d4cb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:18.428432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 245/481] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:18.433833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:18.434643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:18.434934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:18.459969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:18.461159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:18.493022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:18.548126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 237/482] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:18.837187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39e9f-77b1-4993-9841-1b42e3c3d4cb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:18.938906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:18.963776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39e9f-77b1-4993-9841-1b42e3c3d4cb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:19.007917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:19.008549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.008828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.009099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.023986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:19.029381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:19.030263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:19.031075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:19.032140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 246/483] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:19.036713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:19.173677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174282bb-b6b7-4d9a-8cd6-027c0025c349 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:19.223019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:19.223661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.223936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.224202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.224874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:19.225175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:19.226585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018b0bb-e687-44ea-bbbd-7fe565055037 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:19.236692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 238/484] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:19.242417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:19.389671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40107-67a8-4bbf-80c3-acc17dc16c1b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:19.416656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0ed9-780f-456d-972b-f174ccba3b6d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.417261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0ed9-780f-456d-972b-f174ccba3b6d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.417778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0ed9-780f-456d-972b-f174ccba3b6d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.422147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 239/485] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:19.428625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eee3-7d60-463c-a186-06684f6cdd62 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.429082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:19.429690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eee3-7d60-463c-a186-06684f6cdd62 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.429810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.429980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.430259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.430631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eee3-7d60-463c-a186-06684f6cdd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.447732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:19.449190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:19.453985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5ae6eee3-7d60-463c-a186-06684f6cdd62 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:19.455465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ae6eee3-7d60-463c-a186-06684f6cdd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:19.457083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-89cd4982-fe75-45d0-84e5-3849fb5ac099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:19.466656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:19.467810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:19.468842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:19.468842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:19.468842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:19.471101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 247/486] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:19.472370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9ea5-e58b-478a-b43b-a02a6d0e2624 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.472916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9ea5-e58b-478a-b43b-a02a6d0e2624 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.473020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9ea5-e58b-478a-b43b-a02a6d0e2624 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.474588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 248/487] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:19.478889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f9ea5-e58b-478a-b43b-a02a6d0e2624 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:19.487329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:19.542345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 240/488] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:19.544021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d66a-bfcf-48ae-9eaa-f01af2b3fc5b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.544511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d66a-bfcf-48ae-9eaa-f01af2b3fc5b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.545032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d66a-bfcf-48ae-9eaa-f01af2b3fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.562597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a9d4d66a-bfcf-48ae-9eaa-f01af2b3fc5b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:19.564289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a9d4d66a-bfcf-48ae-9eaa-f01af2b3fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:19.599511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f9ea5-e58b-478a-b43b-a02a6d0e2624 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:19.641671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:19.642581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.642945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:19.643307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.643796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.644220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa289-25db-403e-bf31-4f8d36ca1849 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.644504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa289-25db-403e-bf31-4f8d36ca1849 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.644831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fa289-25db-403e-bf31-4f8d36ca1849 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.645253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:19.645751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:19.646362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 242/490] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:19.647587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:19.654548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.654831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.655126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.664536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:19.670313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:19.694135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:19.695367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:19.738832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:19.785147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9affc43-8d61-4ff5-9092-4c2304ce41de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:19.839001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:19.840018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:19.841117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:19.841590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:19.847169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 243/492] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:19.848249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:19.861498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:19.863629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:19.883642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:19.885406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:19.886317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:19.888043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:19.898944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:19.902389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.011622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c42b5-9c38-491f-9e27-9d325add62dc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.051641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878dd0b-8490-49e1-bdbc-91e0ad442038 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.054988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.055663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.055948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.056220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.068522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:20.074427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.076094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.076903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.078459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.099548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.100457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.100917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.101393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.102410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:20.102903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.104770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.150692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:20.151925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.164903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.192690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c33e1-5e91-4e8a-9985-6ef0b836eab5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.228411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.228588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.228775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.229043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.240065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:20.244937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.245810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:20.248327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.252224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.260269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e8b4-17f5-4ca4-a57d-7631d869d464 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.295432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.296052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.296332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.296606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.297267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:20.297577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.298952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.307714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 252/497] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:20.308524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.350099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.360222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9755-bb31-4ea2-83af-d3fe27c8c180 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.397897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.398506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.398784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.399073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.401835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.413268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae35999-908b-4368-9e0f-ed205d4bd1a4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.449373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.450025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.450302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.450569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.460875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:20.466214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.467346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:20.468459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:20.471975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 253/498] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.472789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.476807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.478282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.577824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.582146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443d45-142f-4a97-82df-ccf24dce8184 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.587334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 246/499] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:20.592498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.622379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.622986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.623289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.623569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.624238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:20.624543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.625928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.626793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.634530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 254/500] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:20.635698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.705753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e4c2-a9e5-48f4-84e8-f63922b00169 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.742842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.743504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.743787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.743886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0074cc-ea98-4b00-a325-841d306bafa3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.744057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.754437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.755930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:20.771738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.772869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:20.773737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:20.773737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.773737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:20.773737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 247/501] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.773737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.787013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.787674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.787952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.788222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.788921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:20.789222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.790586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.798568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 255/502] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:20.799443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.824473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.860634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:20.876629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ffce-fbf3-462a-ab13-9509f13c4257 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.899544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c60aff-8ed1-4529-b58b-8180c4b6cbc6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:20.909087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.909734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.910008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.910277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.921283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.922722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.934802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:20.935458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.935744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.936022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:20.937135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.938144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:20.939008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:20.939008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.939008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:20.939008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 248/503] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.939008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:20.951180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:20.952625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-83d341f1-9c2f-4762-84b5-8fc102b800a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:20.966516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:20.967424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:20.968315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:20.968315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:20.968315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:20.968315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 256/504] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:20.968710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67979943-1263-443d-b42a-47c088a7f115 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:20.969026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67979943-1263-443d-b42a-47c088a7f115 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:20.969195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67979943-1263-443d-b42a-47c088a7f115 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:20.970404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 257/505] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:20.971172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67979943-1263-443d-b42a-47c088a7f115 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.042437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4adf85-841f-4744-b54f-74b1ffa92eae None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.049468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.075619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67979943-1263-443d-b42a-47c088a7f115 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.076478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.077209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.077491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.077802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.078448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.078754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.080186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.086985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.092348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 249/506] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:21.093129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.116296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.116930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.117370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.117646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.131951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.133454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:21.147793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.148693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:21.149551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:21.149551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:21.149551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:21.149551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 258/507] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.149771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.195385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d70-c84e-4bfa-812b-583230cb8e7a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.227540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.228142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.228419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.228689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.229324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.229630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.231516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9f13-fcf8-43be-aeb7-3ad2b6cfc812 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.242437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 250/508] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:21.243667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.243955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.244231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.250490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1642d-1ca3-4458-a8dc-145b7b737e6a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.261970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:21.263190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:21.274765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.284254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.284855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.285137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.285411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.286155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.286383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.287781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.300365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 259/509] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:21.301147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.316027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.330061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:21.330868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.405331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7fc2-c42f-4230-a8e1-dc7830eef128 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.441865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.442493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.442776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.443076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.445855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e797c-b7d0-4e74-ad96-cab1e9b41958 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.450241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.451814 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:21.463362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.464262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:21.465193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:21.469814 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 260/511] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.470597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.483671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.484209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.484490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.484749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.485380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.485677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.487068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.504345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 252/512] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:21.504345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.525260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.555438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.582484 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f2fcc-e4bc-44ac-b002-fad801f570d6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.608761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2c20c-0294-454a-a7e0-6504563ac635 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.618203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.618835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.619143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.619416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.625816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.627268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:21.638913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.639801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:21.640655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 261/513] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.641106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.642915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.643652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.643937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.644259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.652078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.654402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:21.666730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.667640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:21.669177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:21.671166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 253/514] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.672181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.740958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e45ff-2683-4b67-8269-c2518c18768b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.747630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.769451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d4df6-6aad-46ed-84d9-42e5094db97e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.775169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.775772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.776060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.776330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.777090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.777417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.778864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.779566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.796878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 262/515] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:21.797670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.807005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.807653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.807930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.808201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.823960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.825940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:21.836819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.837887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:21.838985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:21.843094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 254/516] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.843780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.900678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91c4f-2845-4da0-8241-596567e661eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.933957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.934605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.934885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.935187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.943645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd14c7-48eb-4e84-a240-0a47ecd86a22 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:21.944689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.946121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:21.961562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:21.962469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:21.963637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:21.963637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:21.963637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:21.963637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 263/517] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:21.963848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:21.978878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:21.979515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:21.979797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:21.980070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:21.980762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:21.981094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:21.981515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:21.982531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:21.999883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 255/518] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:22.000615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.027502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.065301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b905-9a63-4e8e-9f4f-c8c95817226f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.098108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.098623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.098899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.099198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.099919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:22.100214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052588e3-8ed8-40b6-b141-4bd272aa05c6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.100655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.101744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.123678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 264/519] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:22.124482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.136297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.136904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.137213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.137972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.206356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.207873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.209153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.234577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.236027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99c56-20d8-4951-97fd-9a28becae878 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.270717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.271273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.271557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.271828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.272564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:22.272868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.274294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.290997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 265/520] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:22.291824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.307117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 256/521] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:22.307930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.392029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e49886-a1de-46f3-b7d6-1b8d1e65a770 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.403674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b31-0639-49a3-84b4-358edfe1a66a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.420108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.425480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.426072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.426348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.426615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.427282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:22.427581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.428938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.430293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.439468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.440058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.440340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.440464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 266/522] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:22.440608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.441220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.441339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:22.441635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.443129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.448412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 257/523] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:22.449169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.556826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e387c-1e4f-4185-b161-837d45751492 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.561994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df22b-e72e-4df8-9c65-4483f967a26f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.596721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.596941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.597346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.597512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.597631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.597779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.597869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.598044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.661241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.665440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.673147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.674626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.676870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.678330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.775112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:22.775952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.783313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:22.784543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.879838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.890404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1da0a-b0f9-4463-9755-eccb77bd517c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.901954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:22.914018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92f539-4e11-4949-9fe5-23b220019af1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:22.924660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.925355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.925626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.925891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.936351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.937821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.949229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:22.950465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:22.950746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:22.951017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:22.951700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:22.953123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:22.953371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:22.954221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:22.955447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:22.955447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:22.955447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:22.955447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 259/526] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:22.955698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:22.981148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 268/527] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:22 2022] POST /identity/v3/users => generated 247 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:22.982380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.079493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b30d9-13de-419e-b0ff-1a2762b4038a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.127098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.127732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.128000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.128275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.139326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adccb8-4b97-45d7-a7d4-f0bf63d5a8ae None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.141493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.143380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.146592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:23.161406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:23.162493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:23.163408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:23.163408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:23.163408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:23.167459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 260/528] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:23.169095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.188670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.189863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.190332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.190844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.202702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.204574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.213419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:23.224509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:23.225450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:23.226289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:23.226289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:23.226289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:23.228305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 269/529] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:23.234126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.293236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66abd4-2b04-4e2a-941b-343d2bc35157 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.333427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.334044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.334332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.334606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.335299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:23.335606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.337305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.351044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 261/530] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:23.355880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.358078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50429-ccc8-42e2-a45d-155ee14c3c94 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.399614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.400575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.401074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.401563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.402411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:23.403579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.405173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.418857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 270/531] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:23.423936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.424072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.489712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.492796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50226c-6b44-4a56-bb20-59ddb5a953cd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.532230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.532892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.533246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.533589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.534291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:23.534661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.536236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.544119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940698f8-dae7-4ce1-be9a-854a0eb6639c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.548232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 262/532] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:23.549160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.593591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.594229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.594642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.595334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.602420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.604123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:23.617120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:23.618004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:23.619166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 271/533] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:23.619640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.672701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe577d3-c0db-47ea-851b-44cb28045c76 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.699578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.709327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.709960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.710239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.710542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.718369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.719892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:23.733335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:23.734178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.735052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:23.739453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 263/534] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:23.740436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.750114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08babc-77d6-48a3-8eed-de944878dece None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.777277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:23.797238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.798537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.798997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.799477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.810286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.812768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:23.829171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:23.830058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:23.830984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:23.836993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 272/535] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:23.836993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.872032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715560-6c35-43ac-be19-b09438a45e54 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.921852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.923192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.924137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.924868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.925824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:23.926576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.928666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.943229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb922-a859-49b0-9832-1127c4827620 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:23.947537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 264/536] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:23.948714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:23.979279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:23.979881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:23.980155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:23.980421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:23.981624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:23.981923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:23.983675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:23.994472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:24.009230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 273/537] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:24.010477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:24.069095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:24.072940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4f044-abeb-4ea2-a142-ac1e343bfe50 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:24.125707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:24.126895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.127439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.128696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.129870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:24.130326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:24.132612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:24.148032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536113-9003-454e-bad7-7d0bf5209eab None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:24.153864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 265/538] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:24.153864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:24.197939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:24.198457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.198807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.199154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.199916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=ad75668ae8ba47e7a3a2736e338c1532) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:24.200223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:24.201655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:24.207677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 274/539] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:24 2022] GET /identity/v3/role_assignments?user.id=ad75668ae8ba47e7a3a2736e338c1532&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:24.208465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:24.271291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:24.287844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c408c3-cb59-4aff-9c8e-25a53401fb2b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:24.335984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf495c-35ae-40f7-8dfe-aeabf4d47b11 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:24.339585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:24.378127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:24.380115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.381589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.382074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.383416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=fc7bd82c6d3b4048a3a0256b8802a86c) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:24.384824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:24.385431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:24.386248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.388660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc575ba-2ece-42ce-8438-23104dd881c3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:24.389180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.389656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.390639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=37a474226dec48deb747b50c68c5b14b) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:24.391183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:24.394699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8c2ec-7014-44ab-b0aa-d1cec75709ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:24.402300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 266/540] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:24 2022] GET /identity/v3/role_assignments?user.id=fc7bd82c6d3b4048a3a0256b8802a86c&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:24.414950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 275/541] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:24 2022] GET /identity/v3/role_assignments?user.id=37a474226dec48deb747b50c68c5b14b&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:24.681602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6572c1-6ed5-48c7-a9bf-24f3b7a87a26 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.682245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6572c1-6ed5-48c7-a9bf-24f3b7a87a26 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.682525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6572c1-6ed5-48c7-a9bf-24f3b7a87a26 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.684211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 267/542] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:24.689650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:24.690102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:24.690197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:24.711341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:24.712842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:24.791612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 276/543] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:25.140394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6572c1-6ed5-48c7-a9bf-24f3b7a87a26 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:25.272917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6572c1-6ed5-48c7-a9bf-24f3b7a87a26 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:25.322625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:25.323609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:25.324066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:25.324663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:25.340586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d2a1b616-785a-4e09-b042-836918a0c229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:25.346154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:25.347266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:25.348246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:25.350612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 268/544] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:25.356178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:25.450833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ab94-31f6-46bc-9d38-8880fd238ad5 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:25.451007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ab94-31f6-46bc-9d38-8880fd238ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:25.451307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ab94-31f6-46bc-9d38-8880fd238ad5 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:25.452885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 269/545] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:25.462593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:25.462881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:25.463192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:25.501473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:25.504887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:25.511637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:25.525002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa080b-f747-4041-ab67-c63d307bfe5b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:25.548376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:25.590976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:25.592523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:25.593132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:25.594421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:25.595339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:25.599377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:25.601351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:25.619981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 277/546] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:25.626378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:25.665683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 270/547] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:25.885164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45896f-d577-48ec-b182-c87cfebef90e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:25.973103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:25.973750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:25.974027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:25.974297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:25.994821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:25.997196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:26.017996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:26.018916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:26.019795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:26.019795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:26.019795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:26.021864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 278/548] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:26.027232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.177584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.225133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:26.265630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b68c0-b3ab-4ba0-ad9f-3d77ec40e0ed None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:26.362501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41380f54-9234-4054-b61b-6eb967852310 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:26.368292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:26.368943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:26.369214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:26.369492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:26.370153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:26.370461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:26.371954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:26.401082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:26.401501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 271/549] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:26.402260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:26.403321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:26.403803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:26.407145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.415210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:26.420981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:26.422383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:26.423380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:26.426054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 279/550] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:26.432370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:26.433297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.510114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:26.545060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c68ff-438d-4904-b972-b8aca6700189 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:26.583254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:26.584210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:26.584711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:26.585196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:26.586049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:26.586554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:26.588338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:26.598002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 280/551] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:26.604023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.668495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6f601-320f-4921-a0bf-777baef93ebb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:26.742525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:26.744767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:26.747264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:26.747741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:26.764222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:26.764222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:26.790953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3905a-8b77-481c-98cc-ed43735dd015 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:26.792333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:26.793585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:26.794485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:26.795572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 272/552] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:26.800187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.861720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:26.862569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:26.862849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:26.863152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:26.869950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:26.893990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:26.895691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:26.919742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:26.920761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:26.921700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:26.921700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:26.921700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:26.921700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 281/553] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:26.928614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:26.955364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.016312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b031-217f-4084-a267-148efcb4be41 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.055379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.055992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.056270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.056541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.057274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:27.057601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.059687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace39b-6b2a-45ba-a0db-b8a9cd927f15 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.072476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23a129-c374-4213-bf24-240561cbb188 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.095251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 273/554] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:27.096504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1a78-851d-466a-9b35-368764111e9d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.096786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1a78-851d-466a-9b35-368764111e9d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.097055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1a78-851d-466a-9b35-368764111e9d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.098427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 274/555] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:27.100152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7f52-bbc1-4095-a4fb-d809b0503597 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.100762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7f52-bbc1-4095-a4fb-d809b0503597 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.102309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7f52-bbc1-4095-a4fb-d809b0503597 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.103813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 275/556] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:27.104506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa7f52-bbc1-4095-a4fb-d809b0503597 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.118159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.118774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.119067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.119346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.119989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:27.120409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.122421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709806-8854-4f7e-a5d5-de04740c662b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.134346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 282/557] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:27.135562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b8fb-dfa7-4d95-b17e-ecf10789beeb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.135843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b8fb-dfa7-4d95-b17e-ecf10789beeb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.136113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b8fb-dfa7-4d95-b17e-ecf10789beeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.155701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1eb0b8fb-dfa7-4d95-b17e-ecf10789beeb None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:27.156918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1eb0b8fb-dfa7-4d95-b17e-ecf10789beeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:27.201741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.227083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa7f52-bbc1-4095-a4fb-d809b0503597 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.235101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 283/558] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:27.235101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d932a3-1bdb-4192-894d-fdb04266ab02 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.235101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d932a3-1bdb-4192-894d-fdb04266ab02 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.235101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d932a3-1bdb-4192-894d-fdb04266ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.255812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.256516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-56d932a3-1bdb-4192-894d-fdb04266ab02 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:27.258299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-56d932a3-1bdb-4192-894d-fdb04266ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:27.266234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.267181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.267181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.267521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.278373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.279923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:27.294389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:27.295538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:27.296427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:27.296427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:27.296427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:27.296427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 276/559] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:27.296653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.336106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 284/560] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:27.344763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3d3f-2fe4-4543-8d4e-eef981470973 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.345120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3d3f-2fe4-4543-8d4e-eef981470973 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.345601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3d3f-2fe4-4543-8d4e-eef981470973 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.350991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 285/561] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:27.350991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa3d3f-2fe4-4543-8d4e-eef981470973 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.411259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983897-0e82-40f1-93da-713c6fb2df38 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.446448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.447392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.447901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.448372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.456770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.458536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-045ebd0c-5336-41a5-b0f2-a2dec1bf7ea3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:27.470804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:27.471884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:27.472828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:27.475020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 277/562] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:27.476493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.476991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.477485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.479887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa3d3f-2fe4-4543-8d4e-eef981470973 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.489693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.498588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:27.500069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:27.522170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.522699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.522975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.523287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.523920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:27.524220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.525576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.537977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.538099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 286/563] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:27.538874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.573575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 278/564] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:27.574691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.669879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbed95-65cb-4612-836c-ef30c809d923 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.681817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531efc44-3ecf-41d6-93f7-594312d7f48d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.704575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.705275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.705605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.705954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.706678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:27.706978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.708424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.719478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.720330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.720782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.721227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.725521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 287/565] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:27.726308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.736131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:27.741872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:27.742782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:27.743929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:27.746426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 279/566] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:27.747403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.754425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.782108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.830901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a4dca-0d57-4559-beed-94dd7b5aa216 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.853941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c65c-9311-4837-a195-172412c705b5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:27.865000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.865623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.865903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.866176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.872643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:27.874074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:27.884883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:27.885951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 288/567] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:27.891326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.892434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:27.893185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:27.893498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:27.893774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:27.904595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:27.909322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:27.910243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:27.911140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 280/568] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:27.912291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:27.971314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:27.987538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c86c3-233c-40a0-aadc-b4c7cf66e6c6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.002089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.012421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777ff55-f9b8-4216-998c-80d97d6bde65 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.021470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.022075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.022354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.022626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.046175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.046714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.046993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.047295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.047954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.048253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.049645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.058142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 281/569] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:28.058746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.089155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.090652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.164192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356e967-0da2-48c9-8ed9-fad1bdf2202f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.171917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.189053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 289/570] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:28.190063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.201799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.202427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.202706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.202975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.212938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:28.218070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:28.219305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 282/571] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:28.220145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.233955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.290705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321fdd-8706-4d77-adc2-484691a6359b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.319808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66823b-4fd6-481a-9233-750202a2acc3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.323118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.323719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.323998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.324269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.325571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.325875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.327317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.338697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 290/572] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:28.339509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.358476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.359116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.359402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.359676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.360338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.360646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.362017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.369919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 283/573] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:28.370685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.388855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.443206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d46018-ba11-4a22-84de-2f6e44d48dd9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.445833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.469821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d97a7-c50f-49a7-afd4-0d1efe0b0136 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.475337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.475959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.476238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.476515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.487169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.488880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:28.503335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:28.504268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:28.505174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:28.505174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.505174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:28.505354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.505354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.505354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.505753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.506024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 291/574] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:28.506920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.516747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.518230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:28.532187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:28.533310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:28.534485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:28.534485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.534485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:28.534485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 284/575] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:28.534485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.599806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.606488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac74be-a20b-4e09-a93d-dbf9d0b9b25e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.630711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfb55a-086a-4ce7-b341-800af03b4983 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.640393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.640994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.641272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.641543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.642503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.643885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.651637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 292/576] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:28.652586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.655530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.665390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.666038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.666316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.666588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.681080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=c91855d376b741ef957a6352eedee1a5, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.682543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.695312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 285/577] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:28 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:28.696099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.755598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7a8c-8ce5-47ac-aa85-5a567ab5ccb3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.797009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.797661 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.797941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.798671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.810838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.812348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.826757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ec931-10f9-444d-a734-d18f945ec8ad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:28.828005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:28.828948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:28.829827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:28.829827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:28.829827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:28.830669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 293/578] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:28.831548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.845846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.872486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.872930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.874131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.874416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.875109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.875420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.876885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:28.891990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 286/579] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:28.892828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:28.934282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:28.947123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6cf5-3e4d-4667-a62d-705cb95fd4a7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:28.984503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:28.985348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:28.985685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:28.985966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:28.986770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:28.987112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:28.989117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.001862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 294/580] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.006890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.010652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57a70-4f70-408c-a489-f4d6afab637b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.048354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.048992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.049272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.049546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.061484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.063091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:29.079004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.080153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:29.081127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:29.081127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:29.081127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:29.081127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 287/581] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.081127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.083529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.123394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552d93-f71c-44b8-95d9-fea6b80f40d5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.169431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.170941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.170941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.170941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.171562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:29.171863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.173242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.184868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.190825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 295/582] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.190825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.202208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2abe2a-2b6f-4ab4-a6be-208099f73134 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.241049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.241679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.241955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.242230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.250684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.252094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:29.263422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.264373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:29.265347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:29.269187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 288/583] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.270008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.290903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c4b00-2fdb-44cb-9012-cd50e82a3048 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.323799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.330133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.330770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.331075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.331354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.338137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.339771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:29.353110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.354194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 296/584] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.360592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.381335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783572-4988-4d08-9f17-848a9ba970a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.417316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.417921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.418761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.419094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.419855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:29.420279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.421649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.438682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 289/585] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.438682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.447417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.463268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067e572-9636-4b7d-b602-2dea2155a8b0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.498283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.498910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.499213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.499482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.507024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.509396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:29.522461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.523436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 297/586] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.524405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.542949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab7c-4f7b-4814-9a4b-722add790c2d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.577688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.582261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.583574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.584070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.585490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.586492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:29.587013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.588689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.606997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 290/587] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.608106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.636285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ff32-b2ee-42e5-9097-9df33f86f992 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.671723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.672934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.673633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.673906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.674219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.674911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:29.675501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.677535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.695289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 298/588] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.695933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.706581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35f1d-7902-49a1-999b-db42befe0e76 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.741804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.742426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.742705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.742977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.751302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.752761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:29.764589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.765719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:29.766988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:29.770247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 291/589] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.771119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.802807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07b24-4158-4e6b-86da-9fdb5f4c4c04 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.815249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.842737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.843366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.843646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.843913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.844633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:29.844933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.846358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.869420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 299/590] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:29.869420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.876475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e22ed-44a6-42fd-a335-58198901f48d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:29.910479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:29.920928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:29.921572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:29.922282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:29.922567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:29.937591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:29.939699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:29.954549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:29.955543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:29.956446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:29.956446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:29.956446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:29.956446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 292/591] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:29.957210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:29.978925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481bf5-7c9c-449b-a838-8c6320a40e73 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.024280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.025122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.025400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.025670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.026958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=e2c9f5ffc72a45848735d1f5d1f3f25f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.027570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.029264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.035602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 300/592] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/role_assignments?user.id=e2c9f5ffc72a45848735d1f5d1f3f25f&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.036726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.075366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b3a9-0d5f-4fc0-be03-da8a67d88c9b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.081299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.137384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.138133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.138745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.139203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.140135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.140550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.142161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.167782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 293/593] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 12 14:00:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.168614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.176816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2ef9-6d08-47dd-80e1-4d4486cbbb08 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.216658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.217337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.217620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.217895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.220647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.232464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.233928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:30.250681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:30.251746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:30.252651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:30.252651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:30.252651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:30.252651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 301/594] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:30.253012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.323550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b2d9-163c-486d-8aad-19aa44839e5e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.344741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.364747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b115e-e783-4a93-88a9-60c6bc205288 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.373607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.374897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.375810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.376264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.377062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.377532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.379753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.398490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 294/595] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.400386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.403754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.405296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.405296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.405296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.416897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.418527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:30.440280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:30.441530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:30.442649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:30.442649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:30.442649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:30.444485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 302/596] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:30.445078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.532355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.541621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4e3f4-2dbb-418e-8134-851846d70d05 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.567760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5314-16fb-4bc7-a435-da737994d2ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.583780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.584390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.584671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.584942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.585687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.586099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.587519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.601423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 295/597] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.602300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.608967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.609605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.609881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.610148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.613458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.618262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.620129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:30.632656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:30.633849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:30.634981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 303/598] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:30.635517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.709422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a1381-cb9e-42ef-99b9-06f10e5d2b82 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.741399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55959756-f572-44a1-adfd-bbdef52ffd92 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.745117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.745925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.746382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.746847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.747684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.748134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.749690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.762631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 296/599] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.763887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.785403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.787279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.787845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.788126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.788459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.797663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.799452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:30.814334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:30.815320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.816221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:30.819094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 304/600] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:30.820091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.880763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc698cb-3826-4d99-a8c9-c0de43ca3ce7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.886389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:30.917900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.918540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.918822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.919186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.920476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:30.920790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.922777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.932938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714bf7-964a-4a57-aa7a-3479a8befc95 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:30.943112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 297/601] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:30.943112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:30.968654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:30.969269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.969543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.969810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.977133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:30.978604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1b21c067-07e2-470e-9152-7e7e5c09d04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:30.990986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:30.991956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:30.992852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:30.996832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 305/602] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:30.998020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66775ed-ea4f-4461-98d6-ed732d3c37ea None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:30.998309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66775ed-ea4f-4461-98d6-ed732d3c37ea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:30.998594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66775ed-ea4f-4461-98d6-ed732d3c37ea None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:30.999859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 306/603] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:31.000530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66775ed-ea4f-4461-98d6-ed732d3c37ea None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:31.035189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:31.063510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a503-7121-40de-a621-e441947f3a62 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.100131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.100884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.101163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.101588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.102272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:31.102578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:31.104136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:31.110930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66775ed-ea4f-4461-98d6-ed732d3c37ea None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.121420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 298/604] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:31.122123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:31.134181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:31.154154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.154786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.155216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.155505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/fc7bd82c6d3b4048a3a0256b8802a86c/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.171240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=fc7bd82c6d3b4048a3a0256b8802a86c, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:31.173303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392c3b1-7f52-4b66-8407-42c1fd963658 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:31.188218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 307/605] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:30 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/fc7bd82c6d3b4048a3a0256b8802a86c/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:31.200522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.200867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.201080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.228387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:31.229492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:31.241224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612834d-b59e-4ee7-8ac0-6f6a3a6fe97a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.283702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.284431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.284781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.285120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.285894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:31.286266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:31.287864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:31.290773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:31.303129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 299/606] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:31.304233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:31.323100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 308/607] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:31.323100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:31.431925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:31.439649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f20e-55cf-4b07-9eed-08fc96f83632 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.480424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.481541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.481812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.482075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/ad75668ae8ba47e7a3a2736e338c1532/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.499014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=ad75668ae8ba47e7a3a2736e338c1532, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:31.500843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:31.516325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880825b-c805-4f95-b85c-bb4cbdfae44f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.519903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 309/608] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:31 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/ad75668ae8ba47e7a3a2736e338c1532/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:31.562935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.563941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.564399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.564854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/37a474226dec48deb747b50c68c5b14b/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.581564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=37a474226dec48deb747b50c68c5b14b, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:31.583317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:31.599657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 300/609] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:31 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/37a474226dec48deb747b50c68c5b14b/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:31.757301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:31.873798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc2af-19b9-4afe-8863-8751e9d98558 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:31.910507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:31.911178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:31.911458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:31.911732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:31.924319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:31.929434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:31.930367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:31.931673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 310/610] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:31.938993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:32.014999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:32.085349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a574f-3bfe-4258-acfd-ed695130cf77 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:32.139754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:32.140380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.140662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.140935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.141616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:32.141923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:32.143337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:32.151942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 301/611] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:32.157409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:32.176869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:32.310194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0c54-0772-4da5-b95e-f1045f8b4a15 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:32.354893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:32.356220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.356504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.356780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.369050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:32.370530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7c2dec64-045e-4c4c-82b5-0564d44f1f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:32.390461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:32.391518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:32.392463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:32.392463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:32.392463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:32.396015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 311/612] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:32.401390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:32.475775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a2dc0-526c-4ff1-9334-5457a0ec120e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.476415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a2dc0-526c-4ff1-9334-5457a0ec120e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.476891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a2dc0-526c-4ff1-9334-5457a0ec120e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.478694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 312/613] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:32.484932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.485471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.485949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.516697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:32.517906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:32.560449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9477-bb9f-4b83-a8eb-4a53e9eccbbd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:32.577195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:32.627396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:32.639952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 313/614] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:32.640323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:32.640947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.641220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.641484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.642135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:32.642436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:32.647062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:32.668819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 302/615] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:32.674151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:32.781905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867048f7-2913-4659-8496-f4cf79b76487 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:32.820798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:32.821789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:32.822286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:32.822780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:32.830933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:32.832666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:32.845213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:32.846175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:32.847177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:32.849605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 314/616] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:32.855001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:32.980123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135fe5-069f-4a06-be76-72ea182c7b24 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:32.995977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.041467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.042082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.042362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.042698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.044177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:33.044485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.047125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.066603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.080578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 303/617] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:33.085669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.140699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.142982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d012c-b940-4da7-b1dc-8ca3572e37f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.182056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.183436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.184548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.185000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.196875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:33.203281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:33.204220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:33.205112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:33.207860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 315/618] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:33.214310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.315276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880940f6-0edb-472f-a017-840bad445fe0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.386660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758dc8-e0ba-41b2-8e17-135b6107c5f6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.398200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.401439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.403144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.403144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.403406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.449414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.450017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.450292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.450554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.451233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:33.451533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.452893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.472482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 316/619] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:33.492585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.547920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.549398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71979e7a-5321-48c5-ade7-eb3342ce746e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.612841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.643894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564f67-e552-468f-b957-ded2a5178605 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.685244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.685873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.686151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.686419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.713082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.714531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:33.741614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:33.744657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:33.751019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:33.751019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:33.751019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:33.751602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 304/621] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:33.751823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 317/621] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:33.751823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.752242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee132d4d-3036-4cef-954d-82157b6ac4c2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.752242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee132d4d-3036-4cef-954d-82157b6ac4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.752242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee132d4d-3036-4cef-954d-82157b6ac4c2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.752242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 305/622] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:33.753010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee132d4d-3036-4cef-954d-82157b6ac4c2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.785608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.864732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee132d4d-3036-4cef-954d-82157b6ac4c2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.886442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be260659-c97b-4463-9983-c0daf8b482e0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:33.891759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:33.902035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.903529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.903966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.904424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.915153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.916850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.927682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:33.928568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.928957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.929286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.929938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:33.930243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:33.931679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-db71cbb5-4c08-478a-a31c-fbcfa7aeb055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:33.934852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:33.935957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:33.937053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:33.937053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:33.937053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:33.938813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 306/623] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:33.940267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:33.940718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:33.941120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:33.952247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 318/624] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:33.953234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:33.961331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:33.962793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:34.039153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 307/625] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:34.040357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.055124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.076777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c307-7ef2-4bab-85c1-00ba66e41ff0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.135270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.136382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.138542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.139071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.140216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:34.141370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.142926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.165469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 319/626] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:34.172350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.250841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c746-9602-4cc2-91bd-195cb5dc4ded None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.274819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.318293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.318932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.319252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.319526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.329796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.331320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.336292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d927b7-efd1-446a-b851-c3999dcccbd9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-169f4dfc-f19d-43e4-9d92-9d6fe97b0a2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:34.343353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:34.349034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 308/627] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627aed-9fa1-478a-a555-c951ca06639c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.350063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627aed-9fa1-478a-a555-c951ca06639c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627aed-9fa1-478a-a555-c951ca06639c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 309/628] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cc6f-b5da-48fd-b770-84f377509730 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cc6f-b5da-48fd-b770-84f377509730 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235cc6f-b5da-48fd-b770-84f377509730 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.350797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 310/629] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:34.351290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235cc6f-b5da-48fd-b770-84f377509730 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.385383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.387054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.387764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.388218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.395080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.396511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-27b13b6d-dfe1-4255-9c38-ece6445211ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:34.408279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:34.409423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:34.410503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 320/630] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:34.411144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac268b8-27fe-46fa-8ca8-76ecd63eaefa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.411144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac268b8-27fe-46fa-8ca8-76ecd63eaefa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.411318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac268b8-27fe-46fa-8ca8-76ecd63eaefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.417323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.430430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bac268b8-27fe-46fa-8ca8-76ecd63eaefa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:34.431660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bac268b8-27fe-46fa-8ca8-76ecd63eaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:34.462876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235cc6f-b5da-48fd-b770-84f377509730 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.495175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.495776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.496054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.496322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.496729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 321/631] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:34.497045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:34.497348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.497939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.498222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.498493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.498921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.520755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 311/632] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:34.520933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:34.521029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.521138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:34.548007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.589125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 322/633] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:34.590560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.631190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854f46-f330-4d21-996f-8539c72c94c7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.657087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.670065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.670901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.671345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.671756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.682810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:34.688059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:34.689206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:34.690241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:34.697390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 312/634] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:34.698445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.701310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b870a-b87f-4662-843d-d9374ba38763 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.737851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.738875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.739275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.739646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.740441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:34.740844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.742367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.755170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 323/635] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:34.756070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.792301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.807855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3c0dc-c5a7-41b3-8a0c-5a151504c495 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.842928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.843602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.843879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.844146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.853754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.855225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.867220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613cc0-07ff-4d81-b60a-2e42d6b878b6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:34.869863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:34.870979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:34.872543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:34.872543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:34.872543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:34.872543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 313/636] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:34.872543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.891950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:34.903885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:34.904489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:34.904764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:34.905032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:34.905685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:34.905983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:34.907510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:34.915065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 324/637] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:34.915833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:34.973475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2078d-b26c-438a-bbcf-0e938fb5611b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.006659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.007282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.007614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.007889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.008613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.008915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.010365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.011246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443c44f-c76d-4e53-8a97-e248c8554f62 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.016495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 314/638] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.017273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.036211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.053354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.054406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.054699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.055273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.068037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:35.073588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.075541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 325/639] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.076609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.138648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a806-9493-4f5a-835e-88a8fb8a9930 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.145270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.178985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.180040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.180190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.180512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.193003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:35.198491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.199787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 315/640] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.200777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.212660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b569fb-a7d3-4af3-a550-8d236891befb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.250962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.251607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.251948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.252454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.252871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.253172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.254541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.269153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 326/641] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.269887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.282590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.328012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308a0f7-0da6-41b8-b0bb-5861af68ef9c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.366187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.366971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.367281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.367556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.377616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7456a-1ee7-4dd6-b510-8f703a82b3a7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.379008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.380474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.380863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:35.395542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.396581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:35.397480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:35.397480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.397480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:35.397480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 316/642] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.397480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.422527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.423179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.423463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.423738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.424406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.424711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.426081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.434627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 327/643] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.435461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.511334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3fa19-9d78-4ed4-b227-a489fdd27a96 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.526320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.544970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f4f9-cf3e-407d-869d-5acff4f8b760 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.550686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.551394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.551739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.552495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.553233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.553608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.555793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.569912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 317/644] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.569912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.580619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.581255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.581529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.582008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.588690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.590758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:35.603151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.604227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 328/645] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.610741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.639181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.683191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cc285-4960-476b-bcde-bcdb90f3cd28 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.715685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.716289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.716563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.716833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.717464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.717761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.718997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce0cc-5928-4e5f-a54f-1f591033cac6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.719233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.732509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 318/646] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.737477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.757777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.758403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.758720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.758992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.772722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.774101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.774818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:35.791159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.792164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:35.793091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:35.793091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.793091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:35.793091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.793091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.854399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eec1f-c310-448e-9ecc-8825ac185cef None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.875055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:35.890006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.890762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.891246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.891560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.899187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ddc6-1718-4afe-ad87-628017f770b0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:35.901803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.903401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:35.919569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:35.920737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:35.921854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:35.921854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:35.921854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:35.923222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:35.924112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:35.940370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:35.941108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:35.941483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:35.941828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:35.942588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:35.943141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:35.944919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:35.957531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 330/649] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:35.958394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.023576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.036501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d568d-7ff6-423c-b67c-4fd264eae717 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.064592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b75a-142b-4596-aef0-c73aefddf596 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.071993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.072617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.072893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.073162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.080410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.081853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:36.092754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:36.093923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 14:00:36.095152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:36.098539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 320/650] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:36.099304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.103908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.104777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.105213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.106203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.106997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:36.107470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.109207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.116752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.124502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 331/651] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:36.129681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.205070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346792-32c1-4dd1-b45f-12b13e933272 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.237791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8281-f58b-42cb-a54f-3cdd9d49b95e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.239304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db900-3207-42e8-8463-68394dba2164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.239911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db900-3207-42e8-8463-68394dba2164 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.240186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db900-3207-42e8-8463-68394dba2164 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.240454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db900-3207-42e8-8463-68394dba2164 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.241092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db900-3207-42e8-8463-68394dba2164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:36.241390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db900-3207-42e8-8463-68394dba2164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.242758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db900-3207-42e8-8463-68394dba2164 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.259406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 321/652] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:36.259406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db900-3207-42e8-8463-68394dba2164 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.269108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.281352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.281947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.282226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.282494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/e2c9f5ffc72a45848735d1f5d1f3f25f/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.297967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=e2c9f5ffc72a45848735d1f5d1f3f25f, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.299487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.313163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 332/653] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:36 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/e2c9f5ffc72a45848735d1f5d1f3f25f/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:36.325189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.377913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db900-3207-42e8-8463-68394dba2164 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.404083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.430200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.430834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.431152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.431449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.432183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:36.432491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.434061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.457975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 322/654] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:36.457975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.491091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73423f-47df-49aa-8016-ebf47529994b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.534868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.535463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.535591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.535756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.536012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.543337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.544752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:36.556461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:36.557454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:36.558415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 333/655] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:36.559571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.591330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038882-aa56-4948-8aad-ab49be51b357 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.640578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.642081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.642559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.643486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.654084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.656669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.668983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9d66-9cf6-4c87-9ba9-5b858e4a4e11 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:36.673487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:36.674427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 14:00:36.675396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:36.676809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 323/656] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:36.677068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.678583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.720206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.720815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.721096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.721362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.800616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a1ef-700b-4352-8be1-780325dffc02 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:36.803816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.805275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.832524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.841912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:36.842533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:36.842818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:36.843123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:36.844100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:36.844658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:36.846049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:36.866315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 324/657] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:36.871807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.930156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 334/658] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:36.931024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:36.941880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:36.985594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71089-5928-4789-a08d-947f50637da8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.023565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.024663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.025177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.025683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.026710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:37.028013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.029644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.036571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70290-1647-4ce0-bcf8-d736c0c20ce7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.054991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 325/659] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:37.056397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.075721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.076330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.076614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.076889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.105113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.157981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.159583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb70163-9374-4a9a-8b31-a1fcc3cfe0b2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.173907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.193207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ba62-0cb8-49dd-a1ec-17e7be9ba67e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.229377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.230104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.230452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.230731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.241689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.243193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:37.259262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:37.260285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:37.261175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:37.261175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.261175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:37.261175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 326/660] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:37.261175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.288884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 335/661] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:37.290657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734548-683f-435d-857a-93e12aaac50f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.291414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734548-683f-435d-857a-93e12aaac50f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.291882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734548-683f-435d-857a-93e12aaac50f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.293744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 336/662] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:37.294984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734548-683f-435d-857a-93e12aaac50f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.359664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.366520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349382-5fa1-42e5-8809-3e02d00b1125 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.401285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.401945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.402245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.402541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.408760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734548-683f-435d-857a-93e12aaac50f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.420121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.454843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.455473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.455751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.456019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.456656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:37.456955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.458309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.470131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 337/663] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:37.472562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.481529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.482991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6395f-45c3-4976-87b8-3d755f7a847a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.578169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.586142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465647e-a763-447e-bb69-87fd90319d3b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.591645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 327/664] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:37.593263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.593560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.593857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.611022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:37.612163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:37.621254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.621893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.622171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.622442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.632978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.634420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:37.649431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:37.650385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:37.651332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:37.651332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.651332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:37.654592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 338/665] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:37.655670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.679085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.683082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:37.683082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.772584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f834-93b7-42a4-89ca-062b36338f67 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.818041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.818752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.819130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.819473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.825618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b9b4-62b7-4b71-8485-ff18fa6363d1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:37.828034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.829647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:37.841672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:37.842580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 339/667] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:37.843533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.857003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.873552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:37.874117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:37.874391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:37.874666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:37.885055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:37.887461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:37.904259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:37.905235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:37.906157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:37.906157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:37.906157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:37.906157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 329/668] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:37.906903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:37.939090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:37.964071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99dc7-9961-472a-8b7d-bb19c9d034c0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.005588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.006509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.006793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.007106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.007865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.008276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.009701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.028573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 340/669] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.028573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.032511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4e51-cbbd-4eff-9b2a-cbd9b9a2484a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.066578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.067489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.067765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.068034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.068740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.069043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.070519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.084390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 330/670] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.085052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.127696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.145354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292d5f-2a38-42a7-a51c-7033f3f4e2ba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.182947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.184260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.184539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.184808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.185441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.185835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.187110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.193475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3831f8-b7f7-47a3-a31f-6ad69a113eeb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.196020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.199521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 341/671] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.200341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.234164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.234910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.235226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.235496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.246805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:38.251947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:38.252902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:38.253754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:38.258186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 331/672] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:38.259175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.310364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811692b-487f-4c4e-bbd2-82c5cdd198eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.346243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.346879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.347195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.347472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.352350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.354873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.357098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.360158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183066-2e69-4572-8918-88a0e98dd3bb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:38.368679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:38.369761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:38.370670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 342/673] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:38.371868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.400447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.400981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.401295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.401574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.402341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=fc7bd82c6d3b4048a3a0256b8802a86c) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.402675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.404153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.419012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 332/674] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/role_assignments?user.id=fc7bd82c6d3b4048a3a0256b8802a86c&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.420346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.441346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.506759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bbabc-4a0d-4eed-a13b-4da79f28face None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.544960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.545585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.545823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.546097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.554009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.555493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:38.569604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:38.570594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:38.571528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 343/675] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:38.572017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.581189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2ba5-ab92-4df3-9c41-539375e52fa8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.625599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.626590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.626946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.627343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.628090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.628401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.629790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.640470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 333/676] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.641552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.668804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.688231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cefd7-0d49-4911-aa10-68a36504a569 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.708478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.724872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.725476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.725758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.726046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.726848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.727184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.728670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728746d-1fdf-4fb9-937b-7a117b2808ae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.745858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 344/677] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.745858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68f44-dd3d-40fc-9361-bda3ae4eef33 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.745858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68f44-dd3d-40fc-9361-bda3ae4eef33 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.745858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68f44-dd3d-40fc-9361-bda3ae4eef33 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.747537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 345/678] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:38.748114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68f44-dd3d-40fc-9361-bda3ae4eef33 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.760419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4538b-242b-43ec-b2e5-b79231b929b8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.795724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.796329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.796605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.796871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.797580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.797882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.799346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.817560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 334/679] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.818239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:38.859930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68f44-dd3d-40fc-9361-bda3ae4eef33 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.899999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.900996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.901284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.901562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.905564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:38.913932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.915403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.926722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf5f4-9c07-4176-8141-66df36736a21 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6fb084a9-abf1-43d8-bd24-8a767256aec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:38.931480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:38.932431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 346/680] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.939358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.954413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:38.956203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:38.965625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:38.966232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:38.966507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:38.966779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:38.967565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=37a474226dec48deb747b50c68c5b14b) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:38.967871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:38.969370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:38.980034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 335/681] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/role_assignments?user.id=37a474226dec48deb747b50c68c5b14b&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:38.981436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.000357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.051844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 347/682] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:39.053163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.169237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89795c-3c0f-41f7-a8f8-334b1f238922 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.229526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.231388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.232127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.233039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.234343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=ad75668ae8ba47e7a3a2736e338c1532) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:39.234868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:39.235513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026effe-73c0-418e-b114-1feba9d2536b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.237643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:39.249399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 336/683] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:38 2022] GET /identity/v3/role_assignments?user.id=ad75668ae8ba47e7a3a2736e338c1532&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:39.278134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.278804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.279110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.279383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.280052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:39.280360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:39.281779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:39.295838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 348/684] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:39.301532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.317799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.362265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.396249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.435185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e255818-307f-4ecf-a505-009ef73ff8d3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.482196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.483021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.483353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.483625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.491621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad20b-f362-423b-8d54-ddfc2fb18fb8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.494550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:39.497125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:39.513433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:39.514419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:39.515406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 337/685] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:39.521835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.542157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.544149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.544419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.544698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.557780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:39.564430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:39.565377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:39.566261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 349/686] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:39.572227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.611066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.648248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fadbb-7239-4e42-aea5-24ba95d1414c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.672624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.694929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.695581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.695859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.696135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.696871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:39.697175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:39.698629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:39.702647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006bec-72c3-485e-92a9-ccd9029faf8b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.744078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 338/687] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:39.746846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.769449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.770068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.770344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.770615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:39.771310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:39.771612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:39.772974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:39.792549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 350/688] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:39.802216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:39.925001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac09b1-1d1c-4c79-992e-7ed98fb9cc78 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.945882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ced5-0ee9-4961-ac63-e85d2c9e26cb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:39.990689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:39.991800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:39.992282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:39.992801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:39.993613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.000921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.001463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.001741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.002012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.028778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.030257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.040085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:40.061869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:40.063050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:40.063940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:40.063940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:40.063940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:40.071460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 351/689] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:40.077267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.079436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.081098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.252437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e5af1-f40b-40c1-b0b6-b89a21cafdde None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.263574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 339/690] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:40.270378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.288461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.289388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.289921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.290373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.291244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:40.291747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.294030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.300303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:40.312246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 352/691] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:40.320476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.415017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:40.432944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924ef42-b614-4f56-9a77-c1e51a9d7958 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.464343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ed68e-11ea-489c-bccb-fc587f9ba57e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.500945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.501586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.501844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.502118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.509739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.511160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.529849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.530889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.531323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.531603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:40.534936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:40.535881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:40.536837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 353/692] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:40.543375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.544862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.547399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:40.562349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:40.564323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:40.565590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:40.565590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:40.565590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:40.565590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 340/693] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:40.569480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.667979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c599bc-2719-4958-b083-949cd01eb695 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.683608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:40.709056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.709980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.710452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.710906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.711824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:40.712154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:40.712366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.714023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.747572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 354/694] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:40.751432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9052449-fc58-4db9-8eb1-46e9d3766025 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.753534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.817856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.818445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.818730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.819002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:40.820409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:40.820711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:40.822090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:40.846500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 341/695] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:40.852209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:40.937065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf635-4f7d-44fa-a57f-7e220c628624 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:40.973003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:40.973979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:40.974492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:40.974965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.040512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.061884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ce64d-89e8-4725-8a6e-3ef298a29089 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.075351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.076761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7a54-377e-4e2d-b8b5-106d44035240 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.105377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.111695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.112163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.112604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.126527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.128459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.131798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ed6096d4-0e89-4ac7-8997-cb9b1b5882be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:41.144373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:41.145498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:41.146559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:41.148584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 342/696] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:41.150082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79cb5-793b-467e-ab56-221316312950 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.150601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79cb5-793b-467e-ab56-221316312950 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.151106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79cb5-793b-467e-ab56-221316312950 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.153421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 343/697] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:41.154342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79cb5-793b-467e-ab56-221316312950 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.202145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 355/698] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 14:00:41.203711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.203999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.204276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.225963 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:41.227159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:41.300002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79cb5-793b-467e-ab56-221316312950 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.311127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 356/699] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:41.312051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.318573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.368107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.370577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.370884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.371182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.371873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:41.372174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.374382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.399538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 344/700] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:41.406026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.493631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77b1f7-1447-4a06-a1be-9f2bdd705354 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.512511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.569645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.570346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.570591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.570871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.585783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.587380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.593685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7f05-648e-4782-aa99-aa021f8ab8e1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:41.617351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:41.618405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:41.619370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:41.619370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:41.619370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:41.620164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 357/701] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:41.628010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.650569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.651325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.651607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.651878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.652628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:41.652934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.654581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.660853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 345/702] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:41.661702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.714501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.773024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6467-4f5a-4c16-90a9-129f18a5d971 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.785074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bf7b2-2f39-4c56-a8ac-f1d2c86407de None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:41.817993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.819214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.819440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:41.820538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.821280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.823199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:41.825154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.827623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a687-883d-4df0-843d-eb77edbbab46 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.834360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:41.835150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.835501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.835863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.848482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 358/703] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:41.850639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebac10-4fa6-47c2-89b9-e837dfe97a71 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.851427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebac10-4fa6-47c2-89b9-e837dfe97a71 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.852041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebac10-4fa6-47c2-89b9-e837dfe97a71 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.852148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:41.853669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:41.853912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 359/704] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:41.854779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebac10-4fa6-47c2-89b9-e837dfe97a71 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b9c9849a-1725-451b-ae32-020f2574f41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:41.874438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:41.875533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:41.876469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:41.876469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:41.876469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:41.876469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 346/705] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:41.877745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:41.878100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:41.878438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:41.903545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:41.905004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:41.981265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 347/706] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:41.982504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:41.989684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebac10-4fa6-47c2-89b9-e837dfe97a71 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.029500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.030139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.030564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.030838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.038775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.040627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-42faadb0-4658-4e80-ba09-945a480c3b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:42.053505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:42.054417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:42.055576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 360/707] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:42.056240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a54b-6419-48b7-a29f-6a709d6dba93 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.056418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a54b-6419-48b7-a29f-6a709d6dba93 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.056696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a54b-6419-48b7-a29f-6a709d6dba93 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.061943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 361/708] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:42.061943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.061943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596a54b-6419-48b7-a29f-6a709d6dba93 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.124909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58852-7c69-466c-9407-a6a29fac21db None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.135879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.167404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.168127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.168404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.168675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.169314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:42.169617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.171058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4201e7e-6d04-4d4d-a7ae-29df58986559 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.187115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 348/709] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:42.187115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.187115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.187115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.202835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596a54b-6419-48b7-a29f-6a709d6dba93 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.204765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:42.206356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:42.247842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.248813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.249303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.249796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.251292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:42.251798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.254245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.270209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 362/710] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:42.272085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.279421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 349/711] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:42.279421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.311366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.385668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f10e1-32b2-49e8-a80f-80335ad8ad78 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.411206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.422277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38289982-a3ff-4c15-8a6e-9563c16fd60f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.437717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.438843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.439297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.439977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.441217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.443097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.462763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.463610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.463997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.464311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.465820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.467399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.473754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 363/712] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:00:42 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:42.474780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:42.479434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:42.481320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:42.482232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 350/713] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:42.487852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.632036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.642966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bb9b7-932c-4fd1-be52-206a7ccd50b2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.643815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0264eb-6ab1-4e1e-8fe2-a7013173f632 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.681603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.682248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.682525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.682796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.683612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=e2c9f5ffc72a45848735d1f5d1f3f25f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:42.683913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.685349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.687783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.689014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.689306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.689586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.690530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:42.690843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.692293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.692407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 364/714] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/role_assignments?user.id=e2c9f5ffc72a45848735d1f5d1f3f25f&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:42.693309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.711661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 351/715] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:42.718312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:42.752345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:42.849344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4ae9-5a6e-43d7-b0a3-8ab17e032a6d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.854001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6666b0-ae94-49ae-8e2c-cbc404a8fdf0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:42.894424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.894943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:42.895491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.897035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:42.897035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.897035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] PATH_INFO: `/v3/services/network` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.897035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.897704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:42.898123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:42.898782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.899099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:42.899564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:42.901193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:42.908337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 352/716] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:42.912228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:42.913495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:42.914585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:42.916666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 365/717] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:42.922525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:43.024918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:43.039249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1a124-48cc-4d23-9c05-f6414f8d2904 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:43.079308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:43.080114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:43.080488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:43.080857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:43.081602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:43.082002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:43.083567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1ac9-219f-4570-8b64-4221b9c588c8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:43.089261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 353/718] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:43.094901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:43.119367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:43.199831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa699-895c-4bc2-83c3-70b70c081620 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:43.234320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:43.235124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:43.235497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:43.235858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:43.236583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:43.236981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:43.238700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db59a0-bef5-4048-8f60-707f0163ceeb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:43.244825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 366/719] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:44.054080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d4fd-3e9e-4dc8-93f0-0a7bbd3b584c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:44.054607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d4fd-3e9e-4dc8-93f0-0a7bbd3b584c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:44.054607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d4fd-3e9e-4dc8-93f0-0a7bbd3b584c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:44.056230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 354/720] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:44.062157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:44.062564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:44.062761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:44.083517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:44.084686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:44.181292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 367/721] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:44.535364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6d4fd-3e9e-4dc8-93f0-0a7bbd3b584c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:44.677447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6d4fd-3e9e-4dc8-93f0-0a7bbd3b584c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:44.722753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:44.723425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:44.727396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:44.727665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:44.738191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:44.743763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:44.744729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:44.745586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 355/722] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:44.751393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:44.792250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:44.922215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a892-b171-4fc9-a93f-bcc38e11d200 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:44.956906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:44.957513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:44.957787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:44.958055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:44.958715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:44.959013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:44.960401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:44.973374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 368/723] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:44.974715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:44.996840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:45.107263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2d363-c66e-4c0a-acaa-8d25e45bb4cf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:45.164639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:45.165281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.165565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.165834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.181751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:45.183256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e38c608b-2535-4e34-9bb4-5c01082c08b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:45.197506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:45.198477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:45.200106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:45.200106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:45.200106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:45.202365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 356/724] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:45.205113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:45.252682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dd75-eaf6-45d1-a2c7-ee95d8c992de None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.252989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dd75-eaf6-45d1-a2c7-ee95d8c992de None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.253218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dd75-eaf6-45d1-a2c7-ee95d8c992de None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.254786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 357/725] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:45.259544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e646c-af85-4e36-9650-75664f163177 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.259827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e646c-af85-4e36-9650-75664f163177 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.260100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e646c-af85-4e36-9650-75664f163177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.297747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-366e646c-af85-4e36-9650-75664f163177 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:45.298965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-366e646c-af85-4e36-9650-75664f163177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:45.302474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:45.345574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6482bc-cd5c-4f4d-89cc-2691be17b050 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:45.407475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:45.408004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.408280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.408551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.409193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:45.409497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:45.410847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:45.414763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:45.428520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 358/726] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 14:00:45.431441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2324f1-bb39-45b3-b8c8-a97341db4478 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.431971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2324f1-bb39-45b3-b8c8-a97341db4478 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.432451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2324f1-bb39-45b3-b8c8-a97341db4478 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.434718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 359/728] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:45.438740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 369/728] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:45.439889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:45.440334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.440819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.441310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.460748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:45.462360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:45.572759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 360/729] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:45.585498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496cb12-40f3-4db4-8146-a70eeddc42ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:45.626069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:45.626701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.626978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.627271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.630040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:45.635107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:45.636585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:45.654997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:45.656029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:45.657040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:45.660793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 370/730] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:45.664156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:45.746470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:45.842778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201349d0-aaab-4d34-8916-f02537e3a2d0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:45.899394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:45.905452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:45.906343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.906830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.907437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.908520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:45.909057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:45.910711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:45.910867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f869-f682-4ec3-bcce-d02d024e72a0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:45.931154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 361/731] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:45.932280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:45.952978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:45.953621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:45.953893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:45.954159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:45.967739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:45.974316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:45.975425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:45.976277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 371/732] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:45.976972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.044210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.048725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd126972-6d10-4c3f-bf8b-21470d0991d3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.094349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.094984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.095296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.095570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.096236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.097661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.099650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae56a2-292c-4d28-b979-0cd1e223fbfc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.124657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 362/733] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:00:45 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:46.126015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.159413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.160263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.160636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.161214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.173688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.175346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-208ce801-df7e-49ff-b63d-a421a21a9cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:46.193606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:46.194636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:46.195753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:46.195753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:46.195753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:46.195973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 372/734] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:46.197179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.197463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6894-79e3-4dca-b68b-881839c93c04 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.198135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6894-79e3-4dca-b68b-881839c93c04 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.198135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6894-79e3-4dca-b68b-881839c93c04 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.203180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 373/735] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:46.205010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6894-79e3-4dca-b68b-881839c93c04 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.272996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2b16-ce45-4530-9a9a-f037795f5ea8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.310567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.311214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.311489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.311765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.313033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:46.313033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.314081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090be2b-9d9d-4403-b5ae-d7fa1c2f32ab None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.327052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 363/736] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:46.327052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.327052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.327052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.327417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6894-79e3-4dca-b68b-881839c93c04 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.328464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.345788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:46.346976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:46.367531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.368154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.368439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.368718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.369371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:46.369678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.371654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac893cf-49c2-4d17-80a9-c77d8fb48ded None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.382984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 374/737] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:46.384238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d538a-1d3f-4cd3-9edc-9b998f5d5849 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.384522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d538a-1d3f-4cd3-9edc-9b998f5d5849 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.384796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d538a-1d3f-4cd3-9edc-9b998f5d5849 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.386152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 375/738] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:46.391462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d538a-1d3f-4cd3-9edc-9b998f5d5849 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.423864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 364/739] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:46.424788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.463466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.524748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d538a-1d3f-4cd3-9edc-9b998f5d5849 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.551745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde4e7-3336-4a2c-99a7-fafb3a81e7df None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.573208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.574694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.575184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.575648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.588309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.591355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.598752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.599483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.599825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.600164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.607734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-54b02ce2-1e4c-408d-af79-b417a777993f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:46.608743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:46.609647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:46.610550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:46.610550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:46.610550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:46.610722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.612767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 376/740] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:46.614654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.615185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.615678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:46.621716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:46.622612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:46.623563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 365/741] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:46.624076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.642128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:46.643768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:46.657497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.729355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 377/742] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 14:00:46.730805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.732494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.739690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fed0fd-c67f-4b48-8184-e543638e2e25 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.776285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.777407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.777685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.777963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.778589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:46.778891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.780995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.796901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 366/743] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:46.797930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.857289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9120df-6b1a-4337-b988-27d0d07b181a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.896689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.897300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.897579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.897849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.898842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:46.899180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:46.900611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:46.913907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 378/744] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:46.914784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:46.915495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b9927-c95a-497a-9da8-a0e17dcb136e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:46.924736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:46.963648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:46.965188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:46.965724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:46.966613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:46.981250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:46.988756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:46.989719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:46.990563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:46.992384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 367/745] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:46.994059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.012032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.036424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e606c-f19f-405a-95e5-34111cf91cc8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.074788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.075611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.075992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.076369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.083930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.085487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:47.101074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:47.102257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:47.103528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:47.110245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 379/746] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:00:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:47.110245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.115128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e0d1-f705-4a7c-9ce6-ad8b8843e3a9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.155929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.156723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.157222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.157593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.159729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=c91855d376b741ef957a6352eedee1a5, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.161550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.187109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 368/747] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:46 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:47.187109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.187455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.229895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78429ef6-27fa-47a2-b60e-a422728c06be None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.269169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.269798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.270151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.270497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.271321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:47.271700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.273285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.287206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 380/748] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:47.288415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.307316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.347773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9fb9-3ddc-4446-90e4-19a55e5c384a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.393991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.394948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.395356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.395712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.396599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.398701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.419609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 369/749] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:00:47 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:47.420405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fef1-97b6-43ad-bf0a-4cc7658024da None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.420856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.451849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.468251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.469137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.469559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.469968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.471061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:47.471506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.473267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.496688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 381/750] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:47.504543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.545181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b945-7c85-4bef-afd5-b356b0982ad4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.586461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.587307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.587715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.588084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.593255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.603510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.605796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:47.623465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:47.624546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:47.625535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:47.625535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:47.625535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:47.626908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 370/751] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:47.632675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.739335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d053fe5-ef27-43d4-949b-4b1c2e7f0663 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.777694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.778309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.778584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.778850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.794032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1484c-3bb3-4ac2-a51f-012db2dc8ac5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:47.836005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.837934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:47.838660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:47.839171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:47.839768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:47.841186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:47.841565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.843046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.856895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 371/752] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:47.861919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:47.862997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:47.864941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:47.918588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:47.981485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 382/753] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:00:47.987184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.009848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3418-cff8-4bf7-9e1a-69a1caedd970 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.084110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:48.092772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.093355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.093635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.093911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.107654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55007-4c6f-4232-badc-3872479f95df None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.115682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.118507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:48.139872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:48.141039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:48.142212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:48.145396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 372/754] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:48.147946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.150557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.151231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.151622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.151975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.163388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.166017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:48.184136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:48.186370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:48.188539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:48.188539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:48.188539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:48.188539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 383/755] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:48.191366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.325891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c7a65-19f6-4172-92cb-5a4c38447fb3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.388554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.389144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.389429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.389701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.390347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:48.390647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.392200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118d2d-cf8b-4ca2-bbdb-1c5fab0f5c67 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.393959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:48.404269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6fe2-ab24-4b98-b57f-686ac09cad4f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.405833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 384/756] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:48.407294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3d1d-9642-4734-8a56-01bea4320434 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.407611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3d1d-9642-4734-8a56-01bea4320434 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.407953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3d1d-9642-4734-8a56-01bea4320434 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.413526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:48.414092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 385/757] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:48.414727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3d1d-9642-4734-8a56-01bea4320434 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.445009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.445619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.445948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.446228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.446958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:48.447306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.449345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2a3b-73f7-4d3f-959f-d2b38521d5f2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.468117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 373/758] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:48.469739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.470110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.470454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.488816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:48.490085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:48.535246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3d1d-9642-4734-8a56-01bea4320434 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.564675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 374/759] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:48.565687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.587562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.589171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.591602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.591886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.606325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.607808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:48.631481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:48.632444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:48.633333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:48.636153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 386/760] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:48.643054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.710783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:48.730162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:48.744407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83585b-2fc0-449d-87ce-5651060b4e2e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.783982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378fd88-16b2-4b3a-af1b-9a48a52bab88 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.818399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.819011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.819345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.819618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.820442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:48.820753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.822220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.834830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 387/761] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:48.840481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:48.841130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:48.841240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:48.841403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:48.841677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:48.945632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:48.947786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:48.968623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bc62-33ef-483b-a897-ce09c27c5528 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:48.985667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.007989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.008739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.009116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.009487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.010369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=f89941d577024d3e93977851c85e05d8) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:49.010791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.012953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.018937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 388/762] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/role_assignments?user.id=f89941d577024d3e93977851c85e05d8&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:49.019834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.071857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.081564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 375/763] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:00:49.087336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.162609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e92f60-3b5c-44a4-bf7e-240f66649e74 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.211647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.211647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.211647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.211647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.212044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.212044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:49.244608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:49.246204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:49.247074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:49.247996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 389/764] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:49.254335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.286795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146d3e-0473-45c0-b88f-56639556b332 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.329570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.330240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.330748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.331021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.343270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.344758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.352849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:49.364126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:49.365128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:49.366513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:49.366513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:49.366513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:49.366513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 376/765] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:49.372696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.450214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.465914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2668-336c-46d2-b83a-bd0c8e6b11d4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.527419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.528221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.528508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.528782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.529416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:49.529718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.531097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.541044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 390/766] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:49.549318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.549812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab30d88-e53c-4c0e-abc3-4b62bcaef0fb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.614818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.615466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.615749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.616021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.616677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:49.616981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.618369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.642709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 377/767] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:49.658097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.715582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d67e6b-739f-4752-a8e3-b06e3e917d2a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.722845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.752780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.754065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.754065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.754290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.754997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:49.755392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.756834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ffb2c-8f09-4a07-b339-5a13dc0ee197 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.762362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 391/768] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:49.767980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f087d8-5a68-4640-8d6b-d76f4c11efa7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.768340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f087d8-5a68-4640-8d6b-d76f4c11efa7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.768685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f087d8-5a68-4640-8d6b-d76f4c11efa7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.774565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 392/769] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:49.774565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f087d8-5a68-4640-8d6b-d76f4c11efa7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.794705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356af1-65ad-4e0b-8769-0625225101ab None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.803538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:49.835776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.836390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.836676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.837003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.844714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.846416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b20f2dfb-689b-4db5-9a93-a4aacd2e0799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:49.858794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:49.859921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:49.860848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 378/770] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:49.861600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.861775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.862058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.881993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:49.883193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:49.895247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f087d8-5a68-4640-8d6b-d76f4c11efa7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:49.936608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:49.937556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:49.938014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:49.938487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:49.939423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] RBAC: Adding query filter params (interface=public, service_id=f6d7eb1ff3334d2d89d2cfa96739f8c5, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:49.939935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:49.941530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:49.950716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 393/771] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/endpoints?service_id=f6d7eb1ff3334d2d89d2cfa96739f8c5&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:49.951901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:49.975196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 379/772] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:49.976406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.000567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:50.079408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4378-3008-48e2-b387-fe6f07341757 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:50.120021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:50.121418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.121798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.122511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.123986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:50.124106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:50.127390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:50.142579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 394/773] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:50.148037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.176673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:50.187656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516988dd-b303-4a43-a464-5e302b4d4f52 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:50.255013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:50.255575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.255856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.256129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.256805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:50.257834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:50.262928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:50.265054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c531d-4ded-40e4-9e67-13a7ccf6053b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:50.275712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 380/774] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:00:49 2022] GET /identity/v3/services => generated 772 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:50.303579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:50.304256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.304544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.304822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.305581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=e2c9f5ffc72a45848735d1f5d1f3f25f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:50.305897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:50.307418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52777a66-da85-476c-bb4a-feadf0d6dab3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:50.314354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 395/775] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:50 2022] GET /identity/v3/role_assignments?user.id=e2c9f5ffc72a45848735d1f5d1f3f25f&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:50.398219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.457533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9d29-66ff-4673-8454-edae77f591c6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.457903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9d29-66ff-4673-8454-edae77f591c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.458102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e9d29-66ff-4673-8454-edae77f591c6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.459827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 396/776] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:50.466306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.467238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.467528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.490005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:50.491351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:50.563197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb729-f75d-4932-b226-edebdcd7a501 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:50.580411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 397/777] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:00:50.605567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:50.606477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.606906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.607379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.622092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:50.627459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:50.628603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:50.629702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:50.632100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 381/778] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:50.638130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.733808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:50.757715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378d645-711e-4792-8866-0be2d5cb181b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:50.799244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:50.799867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:50.800147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:50.800427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:50.801099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:50.801402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:50.802831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:50.812277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 398/779] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:50.817590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.859166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:50.970338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:50.978467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604f21-21cf-4c92-a606-fa25ce6b29ce None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.047777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.048794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.049280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.049848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.072163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.074011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:51.104521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:51.106592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:51.108159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:51.108159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:51.108159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:51.108797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7e0f-fb9d-46cf-b93f-1e9f8febe908 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.120306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 382/780] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:51.132079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.152898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.154440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.154727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.155001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] PATH_INFO: `/v3/services/network` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.155622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.157024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:51.177030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:51.178036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:51.179513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 399/781] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:50 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:51.187972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.297439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.335579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.354579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fb65a-433e-4aea-86b0-d555b694995c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.403872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.404803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.405093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.405372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.406612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:51.406926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.408735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.439923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 383/782] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:51.444960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.488029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2bad0-07a3-46ad-8f12-08191b4d97ef None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.546995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.548120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.548478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.548818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.549681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] RBAC: Adding query filter params (name=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:51.549989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.551492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323f8b5-88b6-462c-8daf-8afee6d50f14 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.558490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 400/783] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:51.559881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dbc28-7009-49ff-bae9-01b5bc798c1c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.560163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dbc28-7009-49ff-bae9-01b5bc798c1c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.560436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dbc28-7009-49ff-bae9-01b5bc798c1c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.570340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 401/784] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:51.570340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dbc28-7009-49ff-bae9-01b5bc798c1c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.601257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cff4-8c40-4db3-a8ae-a8b0238d5d3e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.632340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.637741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.638792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.639153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.639633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.647733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.649521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.661772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-31a91e18-6b45-4e04-a7e2-576d6af42b94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:51.663952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:51.666320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 384/785] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.667937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.668667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.688578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:51.689790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:51.690312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dbc28-7009-49ff-bae9-01b5bc798c1c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.727643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.728296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.728669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.728943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.729680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:51.730007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.731463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.736991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 402/786] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:51.737869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.782036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 385/787] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:51.783287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.898132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04191e56-3cf7-4db9-a948-2ac0b096e99e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.908949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de767127-b0c6-419f-8af4-07bc76c75249 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:51.935176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.935796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.936073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.936343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.937079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:51.937381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.938798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:51.957675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.958322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 403/788] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:51.958539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:51.965051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:51.986852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:51.987509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:51.987851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:51.988131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:51.989164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] RBAC: Adding query filter params (interface=public, service_id=e515a93d6d4e475a97083f9dc71527be, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:51.989478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:51.990922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.009058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 386/789] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/endpoints?service_id=e515a93d6d4e475a97083f9dc71527be&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:52.015258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.083768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b85f-5ef7-482d-b7c4-e1123b55e8e8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.123583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.124203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.124649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.124926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.200318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:52.202000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c429-04d6-4069-850a-8cfdd9e4abd4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.203503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.205260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.247734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.248361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.248644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.248922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.249531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.251414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.263064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 387/790] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:52.263064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.322309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:52.386914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cadaa-2cc4-4345-865d-971d7cedf120 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.396496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 404/791] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 14:00:52.408101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.438942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.441617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.442840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.443585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.470534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:52.481467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:52.482511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:52.483402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:52.490187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 388/792] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:52.498468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.574493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:52.578415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a7033-ba56-420d-81dd-e5802def75ca None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.616335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.617335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.617924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.618408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.626834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a78b94-6612-4ad5-a07b-76290dbf0a82 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.630195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.631919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.638746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:52.648120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:52.649076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:52.649986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:52.649986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:52.649986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:52.652665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 405/793] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:52.657913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.673735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.674939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.675430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.675882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.677047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:52.677811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.679560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.694702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 389/794] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:52.699162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.859648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52021f5-c15b-4117-b4fd-4fc2db53ca13 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.913440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.914563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.914848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.915154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.915815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:52.916121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.917533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf541406-7d34-4720-a44f-6de0cc84d9a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:52.925386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cb2d6-0ae4-46d6-aa27-5dddb228437d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:52.932235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 406/795] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:52.934016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6daa9-229e-45e2-bf0d-156661d52177 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.935404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6daa9-229e-45e2-bf0d-156661d52177 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.935887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6daa9-229e-45e2-bf0d-156661d52177 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.937367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 407/796] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:52.944452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6daa9-229e-45e2-bf0d-156661d52177 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:52.960791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:52.974471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:52.975367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:52.975652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:52.975925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:52.992007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:52.994778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-50d9fdfd-1de6-48c7-8d78-54e41e68428a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:53.013940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:53.014967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:53.015953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:53.015953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:53.015953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:53.016775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 390/797] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:53.017946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c814-cc5e-4929-b3bc-5b676bcfeb27 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.018080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c814-cc5e-4929-b3bc-5b676bcfeb27 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.019067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c814-cc5e-4929-b3bc-5b676bcfeb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.038657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5508c814-cc5e-4929-b3bc-5b676bcfeb27 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:53.039882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5508c814-cc5e-4929-b3bc-5b676bcfeb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:53.057585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.067825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6daa9-229e-45e2-bf0d-156661d52177 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.105052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.108698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.108698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.108698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.118174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.118174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.123227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 391/798] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:53.125362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b3db-2d32-4293-b05f-3fb75af6f23a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.125853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b3db-2d32-4293-b05f-3fb75af6f23a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.126299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b3db-2d32-4293-b05f-3fb75af6f23a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5b04b9c7-b10a-4157-9e65-30bc16a030bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:53.131813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:53.132700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:53.133614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:53.134637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 392/799] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:53.135719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7b3db-2d32-4293-b05f-3fb75af6f23a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.136976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 408/800] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:53.138277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.138616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.138966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.159520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:53.160885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:53.252124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 409/801] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:53.253056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.256691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.275950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7b3db-2d32-4293-b05f-3fb75af6f23a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.358816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.359773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.360190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.360592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.361554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:53.362083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.365587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.395073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 393/802] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:53.399380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.422698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.440841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f61e-d930-4ed4-901e-ea9ca813a41f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.478871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.479652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.480542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.480887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.481706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:53.482078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.483625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.496497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 410/803] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:53.497445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.531372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2616c-2abe-40a9-935e-31fe4ccd60e9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.561871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.577314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.577955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.578654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.578932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.587788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.589747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:53.600751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:53.601721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:53.602680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:53.606395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e5fa-8f1c-492b-8a61-55a6d7f9497b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.607057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 394/804] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:53.607880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.641687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.642233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.642529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.642794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.643406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.644774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:53.654349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:53.655386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:53.656213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 411/805] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:53.657011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.697119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.722234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e0b9-85a5-44a1-8d82-5126cc4e0c86 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.764541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79fc2-03da-492c-81d0-6d20c11e0747 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.765566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.766179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.766457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.766725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.767604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:53.767916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.769355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.783076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 395/806] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:53.783076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.803163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.814158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.814896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.815284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.815618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.828543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:53.834494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:53.835618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:53.836463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:53.837096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 412/807] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:53.837843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:53.908816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cf6e5-504f-4ba3-aebe-e1eb0b12e5a2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.962485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5498e7b-8b72-4c04-9f02-c01fe4cbcd79 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:53.963181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:53.964806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:53.965248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:53.966593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:53.967551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:53.967986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:53.969617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:53.981141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:53.993803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 396/808] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:53.995490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.001884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.002496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.002774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.003154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.003751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:54.004054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.005413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.010296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 413/809] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:54.011668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.066470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.127549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f494be-4bf0-4073-8bd8-bc1b1655d913 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.139264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc16a-3435-41c4-935b-5e1685a049e3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.166993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.167581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.167887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.168128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.168800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:54.169103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.170579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.179902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 397/810] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:54.181252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.187461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.188357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.188831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.189317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.205563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.207839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:54.227785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:54.228817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:54.229742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:54.229742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:54.229742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:54.236442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 414/811] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:54.236442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.252080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.297673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59bc6b-4296-47e1-9f17-d8757319d2b3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.333360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.333971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.334327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.334515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.335194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:54.335500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.336881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.346657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 398/812] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:54.346657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.381367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadfb47-c911-4e0e-8757-1805de5b444f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.382992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.419687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.420642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.421060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.421525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.433691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.435494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:54.451721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:54.452693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:54.453625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:54.453625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:54.453625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:54.460136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 415/813] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:54.461316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.467983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a62c4-b85c-4eff-b1ca-80d9665cf98f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.495979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.509840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.510452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.510762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.511374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.512838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:54.513407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.516870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.539143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 399/814] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:54.540863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.576804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461701-9f5f-4324-b24e-dce649fc69ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.618472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.619296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.619677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.620137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.621360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.622741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.649365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 416/815] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:00:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:54.650486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.666480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.676559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f512f-7e6d-4dd0-a3ad-850e2c84f106 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.724890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.726338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.726789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.727108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.727917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:54.728222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.729780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cad802-1e1f-46cf-87ab-a0090098c2b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.743233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 400/816] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:54.744700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745f2b-f579-4b10-899b-0c432fed3284 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.744986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745f2b-f579-4b10-899b-0c432fed3284 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.745249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745f2b-f579-4b10-899b-0c432fed3284 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.746952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 401/817] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:54.752357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745f2b-f579-4b10-899b-0c432fed3284 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:54.787262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978790e0-850b-4b07-870f-276943d2b5f8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:54.830688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:54.831611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.831965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.832307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.841876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:54.843631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-82478bee-ec77-4594-8f05-c00251246ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:54.857374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:54.858560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:54.859897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:54.863077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 417/818] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:54.863077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:54.863077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:54.863077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:54.884897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:54.886729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:54.939550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.963009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:54.972693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 418/819] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:54.973726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.013740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745f2b-f579-4b10-899b-0c432fed3284 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.082141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.082777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.083065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.083341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.096498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.099213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:55.125594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:55.127004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:55.128966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 402/820] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:55.134762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.184250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b72e7-861c-48b3-af57-76f970389098 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.248148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.248766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.249061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.249430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.250102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:55.250403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.251849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.273086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99430c-5a78-4479-a68e-dbbe053a146e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.273992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 419/821] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:55.274937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.275766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:55.315921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.316953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.317441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.317951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.318889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:55.319410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.321059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.340575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 403/822] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:55.341694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.346093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:55.392566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1648e7-e8c5-407a-83fc-204c003d07d6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.426611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.427270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.427548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.427820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.428471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.429757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:55.439664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:55.440655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:55.441491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 420/823] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:55.442299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.453753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797fcc1-0b65-4c79-a843-2d6a5ef5f0af None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.490856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.491869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.492382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.492797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/f89941d577024d3e93977851c85e05d8/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.509298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=f89941d577024d3e93977851c85e05d8, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.511259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.531180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 404/824] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:55 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/f89941d577024d3e93977851c85e05d8/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:55.532384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.546698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41773e5-9fca-4be5-a4db-30112fc6a9e3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.567486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:55.573312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:55.603011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.604576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.604576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.604576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.626422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.633476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:55.665001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:55.666200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:55.667879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:55.667879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:55.667879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:55.675400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 421/825] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:55.676443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.681375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac78c36-8469-444e-82d6-ed21ba0d464d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.719316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.720197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.720722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.721137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.722062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:55.722513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.724359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.730846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 405/826] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:55.736385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.876411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf86b8-5f22-4655-b143-7c34b2694cbb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.880262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:55.914736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e6e0-a76e-4f8b-ae0a-ebf11deef9cc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:55.936336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.936961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.937243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.937520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.938177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:55.938481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.939901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.957400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 422/827] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:55.960799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:55.966312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:55.966927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:55.967235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:55.967510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:55.968150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] RBAC: Adding query filter params (type=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:55.968452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:55.969836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:55.981798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 406/828] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:55.987898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:56.033789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:56.100333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c08f9-7c19-49f8-86c3-10770fb7a944 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:56.159075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8518cc1-9cea-408b-ae69-5be5d97c7c2a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:56.199102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:56.199994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.200439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.200829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.209012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:56.210631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:56.216468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:56.217102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.217387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.217667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.218360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:56.219774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313a2c-f66e-4d83-99f8-c0d7b602436f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:00:56.223877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:56.224945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:00:56.226127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:56.227823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 423/829] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:00:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:56.232906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:56.235663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:56.262320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 407/830] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:00:55 2022] POST /identity/v3/endpoints => generated 337 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:00:56.316954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf8a6d-f8c0-4cd8-9a10-14de5f1d6187 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.317246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf8a6d-f8c0-4cd8-9a10-14de5f1d6187 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.317526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf8a6d-f8c0-4cd8-9a10-14de5f1d6187 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.319162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 408/831] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:56.324770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.325054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.325370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.345159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:56.346379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:56.452342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:56.460603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be433e-6561-47fc-8aff-6a8869306cb0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:56.497548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 409/832] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:00:56.512324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:56.512950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.513276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.513554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.514268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:56.514574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:56.516122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:56.531108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 424/833] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:56.537028 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:56.642371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f190-ea1c-4b42-a13e-7520b3a0929d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:56.663606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:56.682879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:56.683582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.683862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.684137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/e2c9f5ffc72a45848735d1f5d1f3f25f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.686124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=e2c9f5ffc72a45848735d1f5d1f3f25f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:56.687704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:56.708695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 410/834] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:00:56 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/e2c9f5ffc72a45848735d1f5d1f3f25f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:00:56.810922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:56.936068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd5c8-e917-473a-9afe-5d080fa8b5a2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:56.970511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:56.971269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:56.971559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:56.971830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:56.972457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:56.973808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9c8f173e-d7a2-49ea-b60c-3d7f96e845b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:56.983309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:56.984236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:56.985633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 425/835] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 12 14:00:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:56.990749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:57.102376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c34-cd97-4ed8-bf00-54b6b39330ab None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:57.133306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae11f4-480c-4fe7-8720-6210df317c70 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.133807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae11f4-480c-4fe7-8720-6210df317c70 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.133884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae11f4-480c-4fe7-8720-6210df317c70 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.135861 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 426/836] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:57.144318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.144724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.145095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.147519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:57.148404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.148831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.149265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.150188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:57.150638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:57.152261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:57.157647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 411/837] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:00:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:57.163406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:57.165604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:57.166997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:57.184140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:57.213889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:57.257186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 427/838] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:57.289437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bd1-86db-40f8-9bca-5d8f604db15a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:57.326148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:57.326757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.327046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.327322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.327943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:57.328298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:57.329715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:57.334610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 412/839] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:00:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:57.522010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:57.630346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32169d-8d72-4a85-85be-fa18330f7556 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:57.668009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:57.668988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.669447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.669899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.670716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:57.672347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:57.682625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:57.683769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:00:57.684604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:57.691123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 428/840] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:57.693087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:57.798256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f93c3-2018-430f-a413-4df2f84c07a8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:57.800521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:57.833145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:57.833747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.834019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.834288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.834912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:57.835238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:57.836669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c30fbc-76e8-4322-bf8e-2c00b6133254 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:57.842301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 413/841] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:57.847710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:57.864930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:57.954888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81854d-332c-4571-bb0e-c64e5376a15b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:57.991345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:57.992238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:57.992662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:57.993088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:57.993730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:57.994031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:57.996011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503bc2-7309-49d7-a8ac-5ebbbba7206a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:58.001511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 429/842] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:00:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:58.135458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231cd9-ee11-4a79-873c-4ac6faae0d47 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.136533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231cd9-ee11-4a79-873c-4ac6faae0d47 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.136652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231cd9-ee11-4a79-873c-4ac6faae0d47 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:58.138302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 414/843] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:58.144345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.144877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.144877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:58.164201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:58.165411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:58.243145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 430/844] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:58.519052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231cd9-ee11-4a79-873c-4ac6faae0d47 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:58.623220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231cd9-ee11-4a79-873c-4ac6faae0d47 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:58.658547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:58.659225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.659508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.659781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:58.670383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:58.675341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:58.676254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:00:58.677125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:58.681394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 415/845] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:00:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:58.682829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:58.693097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:58.788051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191db8b-06af-4849-8a4b-af8e4f0e3b19 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:58.824526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:58.825134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.825412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.825682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:58.826343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:58.826642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:58.828024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba16f-c058-4bf4-a03f-39777706773e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:58.836672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 431/846] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:00:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:58.842330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:58.872960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:58.951879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d7cf-cde2-44a9-bbff-64a10c82c8f1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:58.989574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:58.990207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.990483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.990753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:58.998117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0bfc-5ce2-4f5a-9f9f-8301390137e3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:58.998980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0bfc-5ce2-4f5a-9f9f-8301390137e3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:58.999817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0bfc-5ce2-4f5a-9f9f-8301390137e3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.005773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.005773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.006368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 432/847] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:00:59.007949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.008438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.008915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:59.024564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:59.025573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:59.026529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:59.026529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:59.026529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:00:59.026529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 416/848] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:59.031398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.032432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:59.033827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:59.097924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.105276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 433/849] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:00:59.135392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.152675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32d87-0bca-46e8-a7a8-65e4f63a870e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.188773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.189738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.190218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.190688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.191562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:59.192088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.193665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.206682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 417/850] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:00:59.212187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.318808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c654-9336-4a60-9438-1e5cdf6d609d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.353290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.353851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.354130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.354402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.362027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.363916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:00:59.376208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:59.377179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:59.378554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 434/851] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:59.385212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.417988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.494097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f736-0339-4f4e-b60a-c6f68ed1350b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.494449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.533778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.534805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.535323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.535836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.536926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:59.537659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.539439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.549676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b671f-40c7-4e4a-b809-d428a04a1cb9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.552740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.568811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 418/852] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:59.570633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.598146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.598781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.599074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.599350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.614378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:00:59.620894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:59.621924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:59.623462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 435/853] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:00:59.627675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.683806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec5d55-784a-4ccf-9164-d9e7e9fd3621 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.722352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.723685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.724468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.724949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.741922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ac5e-5265-4950-a6fa-c9c7ef277467 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.763417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.779433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.780036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.780309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.780650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.781233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:00:59.781534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.782890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e17f8b-8a88-4a4c-9ab5-6a71c19f949f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.791648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 436/854] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:00:59.793267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355df4-6c41-44a4-9f8b-df9bd49a81b5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.793548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355df4-6c41-44a4-9f8b-df9bd49a81b5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.793820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29355df4-6c41-44a4-9f8b-df9bd49a81b5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.795221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 437/855] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:00:59.800094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29355df4-6c41-44a4-9f8b-df9bd49a81b5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:00:59.800883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:00:59.804494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.805959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cb560-1d56-473b-b937-409c08fc293a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.915518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 419/856] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:00:59.915518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef166a2-0107-494d-b499-4a68c346263c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.915518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef166a2-0107-494d-b499-4a68c346263c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.915518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef166a2-0107-494d-b499-4a68c346263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.915892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29355df4-6c41-44a4-9f8b-df9bd49a81b5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:00:59.930766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-aef166a2-0107-494d-b499-4a68c346263c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:00:59.931969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aef166a2-0107-494d-b499-4a68c346263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:00:59.951911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:00:59.952548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:00:59.952826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:00:59.953103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:00:59.964052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:00:59.965487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:00:59.982159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:00:59.983184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:00:59.984081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:00:59.984081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:00:59.984081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:00:59.984081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 438/857] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:00:59.984081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.005378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 420/858] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:00:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:00.006605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef166a2-0107-494d-b499-4a68c346263c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.028751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.036219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.103903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbe97b-22ac-4a30-b746-4b1ecf77ff33 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.125869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef166a2-0107-494d-b499-4a68c346263c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.155177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.155849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.156235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.156515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.162044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.162744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.162951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.163259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.164021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:00.164329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.165825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.171243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.172742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.184538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 421/859] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:00.185520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:00.191090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:00.192044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:00.193201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:00.193201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:00.193201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:00.193201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 439/860] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:00.199139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.282129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.295457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c82560-55f4-4f7b-856d-2488b1157b63 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.308998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.325452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142499-42e0-44ca-b1ec-0d37e8da7015 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.335593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.336224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.336500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.336770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.344279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.345707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-64a84e2e-74d9-4563-830c-5e57303ad8d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:00.356576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:00.357711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:00.358675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 422/861] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:00.359328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94851-987d-4f39-b09e-6c7dc6d27ff0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.359328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94851-987d-4f39-b09e-6c7dc6d27ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.359456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94851-987d-4f39-b09e-6c7dc6d27ff0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.360629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 423/862] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:00.361287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94851-987d-4f39-b09e-6c7dc6d27ff0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.368777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.369388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.369666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.369939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.371201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:00.371506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.372868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.385416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 440/863] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:00.386783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.461455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94851-987d-4f39-b09e-6c7dc6d27ff0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.485346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26ff72-942a-45f0-82f6-ce14e2618517 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.494441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.495080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.495366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.495645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.496283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.497635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c7eda-78b2-4d4e-a682-7776cf0823f1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.513132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 424/864] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:00 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:00.514553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.514943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.515328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.528014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.529492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.529864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.530215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.531420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:00.531734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.533318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.537492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:00.539011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:00.541843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.554164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.563239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 441/865] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:00.564066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.621990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 425/866] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:00 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:00.623239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.690774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf2a57-8d34-4a6d-a5d2-4d792aea6d9d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.731749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.732829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.732829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.732829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.740554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.742012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:00.754217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:00.755139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:00.756105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 442/867] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:00.762159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:00.770662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71590c4-f361-4e48-8caf-55313a40be6d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.810211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.811245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.811734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.812379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.821557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.830938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:00.879289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bb61-ab48-41ee-aee6-db00bd07e3f9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:00.903928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.905396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.915813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:00.916412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:00.916881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:00.917012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:00.917682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:00.917982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:00.919413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:00.936332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 443/868] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:00.936332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.013779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 426/869] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:00 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:01.014680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.043253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3641f9-c31b-494d-ab98-bdd8f930ec99 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.054668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:01.068371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:01.085122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.085736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.086015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.086289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.086940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.088328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.108121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 444/870] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:00 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:01.108867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.143211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985bc72-3bf6-44a2-a270-21ab35ae554e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.189877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.191300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.191790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.192274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.193239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=f89941d577024d3e93977851c85e05d8) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:01.193764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.195473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.202606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 427/871] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/role_assignments?user.id=f89941d577024d3e93977851c85e05d8&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:01.253178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bf604-651b-4fed-a4ae-aab1da115600 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.297653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.298301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.298591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.298866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.311854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.313567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:01.333738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:01.334760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:01.335775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:01.335775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:01.335775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:01.335775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 445/872] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:01.343564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.453299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:01.457273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d721-749d-40b0-815c-57dceb52035a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.496017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.496632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.496909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.497181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.497827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:01.498123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.499535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.512689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 428/873] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:01.517888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.552681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:01.625764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf928e-0391-4018-8d13-8c43c5ca9cd3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.661571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.662201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.662478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.662746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.669823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.671288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:01.682752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:01.683737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:01.685222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 446/874] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:01.689919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.798551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f4ad-329c-4481-be03-e48be865ae2a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:01.835641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:01.836593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:01.837090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:01.837366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:01.838064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:01.838371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:01.839872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b58dd0-d3b2-411c-ac65-ee23f0b5a292 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:01.852749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 429/875] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:01.858845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:01.958024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:01.967307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412810-3564-43e8-b4d8-32a56bad3145 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:02.002490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:02.003118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:02.003397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:02.003665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:02.004394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=e2c9f5ffc72a45848735d1f5d1f3f25f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:02.004697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:02.006116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9ab43-4a7f-4884-86ee-aa882b379e52 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:02.012870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 447/876] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:01 2022] GET /identity/v3/role_assignments?user.id=e2c9f5ffc72a45848735d1f5d1f3f25f&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:02.799064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2163d5e-8c6a-4d97-b648-28b6a21f2f47 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:02.799593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2163d5e-8c6a-4d97-b648-28b6a21f2f47 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:02.799593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2163d5e-8c6a-4d97-b648-28b6a21f2f47 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:02.801207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 430/877] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:02.806449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:02.806849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:02.807058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:02.826559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:02.827779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:02.901224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 448/878] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:03.180747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2163d5e-8c6a-4d97-b648-28b6a21f2f47 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.201726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:03.288803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2163d5e-8c6a-4d97-b648-28b6a21f2f47 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:03.332310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:03.332965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.333245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.333522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.334125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:03.335600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c27390cb-6d9d-4c4c-a42e-e98a4646d9ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:03.345530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:03.346593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:03.347600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 431/879] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:03.352715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.438656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da882cdd-7379-4f9a-a180-845a63c7bdb2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.438854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da882cdd-7379-4f9a-a180-845a63c7bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.439260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da882cdd-7379-4f9a-a180-845a63c7bdb2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.440718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 432/880] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:03.444309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:03.447436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e23f-6387-4e51-acff-1e1a419fa38d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.448792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e23f-6387-4e51-acff-1e1a419fa38d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.449230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e23f-6387-4e51-acff-1e1a419fa38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.457358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb73ab-5754-4dff-a96d-5a8fcd47bda5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:03.470167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0ea7e23f-6387-4e51-acff-1e1a419fa38d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:03.472004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0ea7e23f-6387-4e51-acff-1e1a419fa38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:03.497767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:03.498404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.498685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.498959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.499650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:03.499984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:03.501365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:03.511074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 449/881] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:03.512769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.568103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 433/882] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:03.614027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5a2b1-61e8-4623-a459-a491cca59f2d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.614363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5a2b1-61e8-4623-a459-a491cca59f2d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.614584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5a2b1-61e8-4623-a459-a491cca59f2d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.616175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 434/883] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:03.621331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.621851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.622336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.625083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777361c1-e488-4c2a-98de-325f42da8ff1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:03.645373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:03.647295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:03.658383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:03.660247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:03.661664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.661664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.661858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.662552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:03.663070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:03.664780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:03.671280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 450/884] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:03.677030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.719399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:03.734332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 435/885] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:03.787702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3870fe-1da3-4846-a8b1-01c99747b0d7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:03.824460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:03.825865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:03.826359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:03.826830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:03.827808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] RBAC: Adding query filter params (interface=public, service_id=62e8faf6beb140e4b316d14380d3aa34, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:03.828474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:03.830035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:03.835866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 451/886] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/endpoints?service_id=62e8faf6beb140e4b316d14380d3aa34&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:03.842203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.856251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:03.945886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:03.958307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a424-0359-471e-8ab0-d37500935a66 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:03.970991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8594f96-0319-4d7e-ba05-10f5d5e6eb02 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.001609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.002779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.003280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.003983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.005203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.007243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.009538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.010251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.011449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.011799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.012451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.013917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.015452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 436/887] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:01:04.032154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:04.034798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:04.035835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:04.036679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 452/888] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:04.044176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.045782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.180390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f183-b19d-4f8e-958f-d2b420d9cac0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.188688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dd05b-9d5c-499d-977f-da0b340594e7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.222936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.223534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.223815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.224087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.224723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:04.225194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.226382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.232499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 453/889] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:04.239334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.239618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.239976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.240249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.240515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.252761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.253298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:04.258628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:04.259732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:04.261389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 437/890] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:04.267942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.346538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.354927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a1ef-0f73-4fe1-90d9-7907b95635fb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.389641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c67a7-a8e7-4b01-8c66-3d207d4bd217 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.390648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.391299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.391580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.391852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.392485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:04.392802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.394193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c66ad1-9e61-4da0-ba72-4a64c5520291 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.417483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 454/891] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:04.418802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49551a-4426-4239-bb62-958400da9fe3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.419115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49551a-4426-4239-bb62-958400da9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.419391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49551a-4426-4239-bb62-958400da9fe3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.423071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 455/892] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:04.423217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49551a-4426-4239-bb62-958400da9fe3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.434337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.434941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.435479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.435598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.436220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:04.436528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.437896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d20e5-b705-4955-94b0-a9803d0446a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.451693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 438/893] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:04.453224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.453512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.453790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.472373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:04.473712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:04.496225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.533641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49551a-4426-4239-bb62-958400da9fe3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.549394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 439/894] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:04.555212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.573916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.574521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.574801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.575095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.575798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] RBAC: Adding query filter params (interface=public, service_id=2b83e366619a451caba4fb5f043b4872, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:04.576102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.577464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.587084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 456/895] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/endpoints?service_id=2b83e366619a451caba4fb5f043b4872&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:04.588558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.627716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.680275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8001f-b95f-42d1-a548-fefdc6a3e3bf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.708441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd7d-b17b-4064-bef1-27bdb4b30e79 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.729054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.730155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.730429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.730695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.745829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.747333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.749663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.750580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.751117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.751600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.752419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.753988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.755855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:04.768498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:04.769545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:04.770452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:04.770452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:04.770452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:04.770452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 440/896] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:04.771721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 457/897] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:01:04.776077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.843923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:04.904439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cde64-56ea-4571-9e23-935837d12583 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.921762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:04.954786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:04.956077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:04.957075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:04.957669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:04.958635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:04.959128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:04.960004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b30ca-d0e0-48ec-81a2-140ba11072e9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:04.960928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:04.977954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 441/898] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:04.984863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.007068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.007725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.008012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.008289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.008888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.010907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:05.021748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:05.022759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:05.023636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 458/899] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:05.029349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.103864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:05.131052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64fd0-1907-4286-bf05-b0604b888cc9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.155659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1faf8-637a-4b3e-917d-682aed73e97f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.172569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.173605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.174104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.174393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.183019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.184603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.196054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.196668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.196949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.197225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.197858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:05.198725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.200132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:05.200467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:05.201389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:05.202370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:05.206223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 442/901] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:01:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:05.207821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.209756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 459/901] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:05.210649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.240987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:05.315743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a319-c41b-47d8-ab0a-74d333bd8765 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.331694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bcb3c-94cb-4aee-ba9a-96f6f1320286 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.352461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.353009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.353291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.353565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.354343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:05.354655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.356240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.362652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:05.375065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.375893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.376015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 443/902] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:05.376449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.376880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.377666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:05.378128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.379675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.381181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.384878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 460/903] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:05.491585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:05.505483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94bce-c32d-4921-8561-ce870f804ddb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.551467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.552453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.552739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.553013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.629834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.631749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.724050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:05.739911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 444/904] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:05.748200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:05.853962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8092e7-2b08-43ac-b3ff-48888b4669e0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:05.889627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:05.890263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:05.890543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:05.890815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:05.902045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:05.903539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:05.918469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:05.919456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:05.920499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:05.920499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:05.920499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:05.920499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 461/905] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:05.927104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.030597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3e17-8c28-4144-b797-d84c1d58ac81 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.069688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.070301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.070580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.070851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.071518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:06.071824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.073235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201638b-f3f4-47c3-bd03-d79fc4809e4a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.085570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 445/906] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:06.096153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.144834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:06.213382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07f154-0526-4aff-9313-6ee4acfb54b9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.248277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.248909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.249188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.249460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.256324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.257769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.264596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca042-b724-4457-a9da-5a69238a2858 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.264884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca042-b724-4457-a9da-5a69238a2858 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.265159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca042-b724-4457-a9da-5a69238a2858 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.266615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 446/907] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:06.271716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.272229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.272705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:06.273215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:06.274104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:06.274994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 462/908] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:06.281300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.294565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:06.295877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:06.342527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:06.369679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 447/909] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:06.398720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c145d53-1876-45e4-822e-04f9375b34c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.400305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:06.433733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.434338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.434616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.434887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.435609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:06.435912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.437324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.450136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 463/910] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:06.456455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.559353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186fdd2-6958-4c95-b02c-a6105edfe1f4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.599271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.599886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.600166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.600443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.601174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] RBAC: Adding query filter params (role.id=e9ccd6a06dd0407cb45d35a4489fd65e, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=f89941d577024d3e93977851c85e05d8) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:06.601481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.602914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.609326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 448/911] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/role_assignments?user.id=f89941d577024d3e93977851c85e05d8&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=e9ccd6a06dd0407cb45d35a4489fd65e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:06.635489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.745870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc5ca6-6d96-4ad5-bbcb-071b218d54a9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.784327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.785188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.785384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.785655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.786254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.787663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:06.798873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:06.799905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:06.801407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 464/912] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:06.805817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.852405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:06.911836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8308ee-e362-437d-9c89-c67a2d263710 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:06.951549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:06.952215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:06.952464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:06.952724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:06.953372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:06.953680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:06.955129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bad54-43b8-42f4-a787-9a4cf3a34d00 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:06.960958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 449/913] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:06.966316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:06.996523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:07.051639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7da9e-cc20-46c9-a3f7-ffbd2404a581 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.051985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7da9e-cc20-46c9-a3f7-ffbd2404a581 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.052193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7da9e-cc20-46c9-a3f7-ffbd2404a581 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.053832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 450/914] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:07.059226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.059506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.059774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.076806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17e374-6bcc-4bf1-bb88-80ad0d3af66d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:07.078934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:07.080198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:07.117016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:07.117941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.118417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.118870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.119702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:07.121207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:07.123075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:07.129210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 465/915] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:07.134878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:07.167117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 451/916] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:07.240186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:07.250787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d137e0-eb12-40c5-9a83-bb0c9e64a5e4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:07.285796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:07.286821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.287334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.287844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.288697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:07.290234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:07.315151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 466/917] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:07.435796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:07.471871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:07.548940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b92243-0ade-4627-b63e-8d6e10fb316c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:07.590246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:07.590886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.591192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.591462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.592103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:07.593491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:07.602656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:07.603717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:07.604615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 452/918] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:07.610106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:07.720690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1091-f2bb-4435-bdbc-2e2d3c178511 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:07.755066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:07.756081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.756563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.757036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.758053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:07.758576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:07.760201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ab5f-ed63-48e7-bd37-c423bd7b5627 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:07.766433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 467/919] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:07.775253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:07.791475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cfb-53e4-4e0f-af08-78a29c6b6435 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.791781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cfb-53e4-4e0f-af08-78a29c6b6435 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.792106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cfb-53e4-4e0f-af08-78a29c6b6435 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.793682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 468/920] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:07.799021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.799352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.799625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.820476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:07.822690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:07.826726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:07.881158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:07.889006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7628d56-aa41-4344-a63f-83d3d9396a18 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:07.908033 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 469/921] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:07.930736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:07.931430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:07.931711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:07.931983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:07.933135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:07.933436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:07.934816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:07.940017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 453/922] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 12 14:01:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:07.945950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:08.048869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd7e1f-a8c0-48ba-b9fe-7f80f2e84125 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:08.084569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:08.085434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:08.085893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:08.086340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:08.087233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:08.088893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169291a-4573-4fc1-a178-525931af7e09 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:08.098488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:08.118227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 470/923] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:08.191850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:08.306779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ebf2a-9f66-476f-98f8-2cf168ce5fcb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:08.349932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:08.350560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:08.350842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:08.351146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:08.351816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:08.353300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69558bc-da5b-4d52-8cde-f61b9fa5055f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:08.373915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 454/924] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:08 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:08.826867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa030fe-5949-4b15-95e4-554848a1c68a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:08.827224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa030fe-5949-4b15-95e4-554848a1c68a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:08.827482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa030fe-5949-4b15-95e4-554848a1c68a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:08.829103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 471/925] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:08.834275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:08.834567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:08.834844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:08.853726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:08.855534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:08.866942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:08.937526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 455/926] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:09.206769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa030fe-5949-4b15-95e4-554848a1c68a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:09.315479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa030fe-5949-4b15-95e4-554848a1c68a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:09.349713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:09.350344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.350624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.350895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.362954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:09.368340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:09.369244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:09.371117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 472/927] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:09.377925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:09.480504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f7d4-eb9f-4fea-b20f-b42751bc5c64 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:09.515262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:09.515875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.516151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.516427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.517148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:09.517456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:09.518825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d15f-7bd3-49ca-a9e6-1c6843d1d7c5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:09.527952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 456/928] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:09.536300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:09.598499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:09.648056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731bf46-bc8e-47c8-bef7-3c3b40914b93 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:09.682748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:09.683453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.683738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.684008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.690450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b5a9-b59c-4217-99b8-238a81c25abe None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.690928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b5a9-b59c-4217-99b8-238a81c25abe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.691374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b5a9-b59c-4217-99b8-238a81c25abe None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.693348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 457/929] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:09.697688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:09.697688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:09.699797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.700286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.700756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:09.713542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:09.715323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:09.716280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:09.716280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:09.716280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:09.716280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 473/930] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:09.717111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:09.721197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:09.724845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:09.726326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:09.803296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 458/931] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:09.842642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a107-b19d-4b9a-b774-534d0b1aaf1a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:09.851599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:09.877269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:09.877876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:09.878157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:09.878427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:09.879090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:09.879396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:09.880762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:09.893231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 474/932] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:09.898780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.003233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98ecbf-c7a1-49ab-98bd-e62519819827 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.039858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.040551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.040836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.041106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.043049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.049721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.051410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:10.064093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:10.065114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:10.066113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 459/933] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:10.070992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.085602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.192582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12723ecc-29dd-42b4-9725-7c44d3e5eca8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.233082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.234482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.234991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.235491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.236471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:10.237001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.238922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.240381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e605b-f6a7-4923-baab-7b033112e1f1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.263278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 475/934] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:10.264848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.284026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.284957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.285272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.285498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.286109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.290559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.302400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:10.304918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:10.306604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:10.309013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:10.311777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 460/935] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:10.314510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.386402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.399341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e23107-5f50-4bb5-ba57-911ad97a07b9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.435060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bea86c-15b2-4c80-8ea1-4213301862a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.435960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.436615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.436893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.437159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.448154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.449523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-32b6fdc0-b301-4ea9-b569-3f1b81fdc5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:10.465095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:10.466303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:10.466303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:10.466303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:10.469587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 476/936] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:10.470823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2c3b-78bb-4a98-aa01-76e5c8c1073f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.471127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2c3b-78bb-4a98-aa01-76e5c8c1073f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.471400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2c3b-78bb-4a98-aa01-76e5c8c1073f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.472809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 477/937] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:10.473344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d2c3b-78bb-4a98-aa01-76e5c8c1073f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.477185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.478097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.478654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.478935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.480185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:10.480493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.481880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd961a-9bcf-4e47-866b-d848705f8941 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.495361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 461/938] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:10.495361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.495361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.495361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.510963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:10.512297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:10.571885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.599056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 462/939] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:10.599056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.601317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d2c3b-78bb-4a98-aa01-76e5c8c1073f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.639546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.640172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.640558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.640827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.641576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:10.641884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.643345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.664179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 478/940] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:10.666443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.669398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.718081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d89b-ceeb-4486-8597-00e68fa7d2ae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.754474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.755114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.755398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.755672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.756311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:10.756614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.758103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5140a41-ca96-4721-99ac-3e48f2180c62 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.762880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 463/941] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:10.764144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f38d-d033-4ca1-941b-34963abcbe68 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.764448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f38d-d033-4ca1-941b-34963abcbe68 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.764709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f38d-d033-4ca1-941b-34963abcbe68 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.770070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 464/942] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:10.772129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.772653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.773147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.779476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0af03-1fc2-4ee8-a782-54e3138f6cba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:10.795719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:10.797338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:10.830105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:10.830767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:10.831065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:10.831346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:10.841349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:10.842838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:10.844900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:10.860296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:10.861288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:10.862228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 479/943] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:10.867772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.883120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 465/944] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:10.884361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:10.948597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.007393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca5573-b962-48ac-84b6-1e009cc66c0b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.020946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a11d3-8737-4a26-bd95-890b59231876 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.047657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.048609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.048956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.049281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.050050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:11.050414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.052909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.057050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.058431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.058910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.059415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.060269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.062086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.065236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING keystone.server.flask.common [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 12 14:01:11.067068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 480/945] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:11.072612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.085587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.sql.core [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 14:01:11.085587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 14:01:11.085587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [parameters: {'id': '9d882957248a47568f834e9e4b6ca21a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 14:01:11.085587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81611) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d882957248a47568f834e9e4b6ca21a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d882957248a47568f834e9e4b6ca21a. Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:01:11.094180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 12 14:01:11.095198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application yield resource Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise self.value Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application session.commit() Sep 12 14:01:11.096188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.flush() Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application compat.raise_( Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 14:01:11.097413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 14:01:11.098574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:01:11.099486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [parameters: {'id': '9d882957248a47568f834e9e4b6ca21a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.100368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:11.102132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d882957248a47568f834e9e4b6ca21a. Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 466/946] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Sep 12 14:01:10 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:11.104135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.149991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.197552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b441-6561-4a9e-87cd-a39a0b991794 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.235834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.236594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.236774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.237055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/f89941d577024d3e93977851c85e05d8/roles/e9ccd6a06dd0407cb45d35a4489fd65e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.237362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872befc-c7da-4363-b755-04d16507e17e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.239526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=f89941d577024d3e93977851c85e05d8, role_id=e9ccd6a06dd0407cb45d35a4489fd65e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.240025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.241793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.267151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 481/947] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:01:11 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/f89941d577024d3e93977851c85e05d8/roles/e9ccd6a06dd0407cb45d35a4489fd65e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:01:11.267151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.294600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.295445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.295858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.296212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.307363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.310362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:11.326252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:11.327324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:11.328284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:11.334508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 467/948] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:11.336596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.404638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74587-6e43-45e0-a02f-cc573c22a272 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.426378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.449261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.449899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.450176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.450443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.451063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.452463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.461451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46921c82-0fe1-4e70-9b42-de015faea4d7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:11.464751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:11.465916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:11.466781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 482/949] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:11.473604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.510823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.511518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.511799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.512068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.512738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:11.513037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.514479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.542042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 468/950] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:11.592984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbcba2-82de-451b-b5b2-346652782186 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.631708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.632329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.632609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.632883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.633535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:11.633838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.635869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.641763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 483/951] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:11.647344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.676075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.766122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a3a6b-05dd-4385-b00d-84abdd3fa574 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.806051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.806575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.806855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.807236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.807877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:11.808176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.809558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.816085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 469/952] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:11.821782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:11.872311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:11.929852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d0fde-c069-4862-aaed-eebd2c09a3f0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:11.964602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:11.965201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:11.965532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:11.965803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:11.966552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] RBAC: Adding query filter params (interface=public, service_id=ec532d8db1a041f9a8affeb0ca26e0a9, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:11.966864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:11.968362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3791e1f-d3eb-4e00-9989-0aafb6c4b8d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:11.973760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 484/953] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/endpoints?service_id=ec532d8db1a041f9a8affeb0ca26e0a9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:11.979441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:12.068386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:12.083936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682d888-a9d4-4416-bba8-20f0c512684a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:12.126445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:12.127091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:12.127644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:12.127924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:12.128526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:12.129910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307397-c19a-43aa-985d-ce1ccd1f4713 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:12.136550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 470/954] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:11 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:01:12.975181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dacd6f-3538-427d-8c56-ce4f0b8c0044 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:12.975701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dacd6f-3538-427d-8c56-ce4f0b8c0044 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:12.975701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dacd6f-3538-427d-8c56-ce4f0b8c0044 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:12.977298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 485/955] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:12.982643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8396e3e-5966-4a52-8bd0-68ce26c6d613 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:12.983062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8396e3e-5966-4a52-8bd0-68ce26c6d613 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:12.983290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8396e3e-5966-4a52-8bd0-68ce26c6d613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:13.002509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c8396e3e-5966-4a52-8bd0-68ce26c6d613 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:13.004085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8396e3e-5966-4a52-8bd0-68ce26c6d613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:13.075845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 471/956] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:13.346082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dacd6f-3538-427d-8c56-ce4f0b8c0044 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:13.454596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dacd6f-3538-427d-8c56-ce4f0b8c0044 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:13.467239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:13.495714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:13.496328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:13.496607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:13.496880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:13.497551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:13.498924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25f99-5f18-47ec-809c-8767e39d4327 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:13.518324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 486/957] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:13 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:13.587470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac2c2-d525-4d6f-844e-5956e1630bbf None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:13.587803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac2c2-d525-4d6f-844e-5956e1630bbf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:13.588092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac2c2-d525-4d6f-844e-5956e1630bbf None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:13.590441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 472/958] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:13.596470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66857c-ae5e-4070-86bf-12a5ee480c8c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:13.596759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66857c-ae5e-4070-86bf-12a5ee480c8c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:13.596944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66857c-ae5e-4070-86bf-12a5ee480c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:13.617976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3a66857c-ae5e-4070-86bf-12a5ee480c8c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:13.619210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3a66857c-ae5e-4070-86bf-12a5ee480c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:13.696465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 487/959] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:13.965248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ac2c2-d525-4d6f-844e-5956e1630bbf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:13.984469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce6531-f894-43a6-a39a-a70c3f6a43f5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:13.985446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce6531-f894-43a6-a39a-a70c3f6a43f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:13.985936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce6531-f894-43a6-a39a-a70c3f6a43f5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:13.987802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 488/960] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:13.992711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:13.992996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:13.993278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.012677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:14.013880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:14.058089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.084944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ac2c2-d525-4d6f-844e-5956e1630bbf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.095362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 489/961] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:14.133477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.134120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.134398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.134671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.145831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:14.150640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:14.151709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:14.152777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 473/962] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:14.159645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.188102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.263308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291320-70e1-4686-bbec-25802dcb5324 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.301760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.302704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.303214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.303685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.304547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:14.305039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.306616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.317205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 490/963] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:14.323273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.391061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.430599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d15f-475d-48a3-810e-e1a60a061617 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.470666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.471451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.471724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.471991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.480714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.483456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.485757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.489626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4f804d52-6bf6-4d04-86fe-9555ffe3f75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:14.501931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:14.502881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:14.503865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:14.503865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:14.503865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:14.504040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272fd3-d027-4c22-9b33-fb5e48c4b280 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.507172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 474/964] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:14.508657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b25b-6c88-4579-98fb-da8b2088eb4d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.508937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b25b-6c88-4579-98fb-da8b2088eb4d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.509207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b25b-6c88-4579-98fb-da8b2088eb4d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.511615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 475/965] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:14.512186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119b25b-6c88-4579-98fb-da8b2088eb4d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.543217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.543817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.544031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.544306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.544955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.546378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.548927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING keystone.server.flask.common [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 12 14:01:14.562969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 14:01:14.562969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 14:01:14.562969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [parameters: {'user_id': 'a02e3ec5612a4f70b860e00208063b38', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 14:01:14.562969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-64711f49-7268-474d-91bb-ad754c171131 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Sep 12 14:01:14.581521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:01:14.582480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 14:01:14.584047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 14:01:14.584956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 14:01:14.585947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 14:01:14.586787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a02e3ec5612a4f70b860e00208063b38', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:14.589784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 12 14:01:14.592187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 491/966] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 12 14:01:14 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.594367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.604615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:14.606147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:14.631922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119b25b-6c88-4579-98fb-da8b2088eb4d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.669210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.669849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.670149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.670423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.671090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:14.671577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.673021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.673622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 492/967] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:14.674274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.703912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 476/968] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:14.705245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.759254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.769915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:14.780382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f944a-35af-493b-985b-a5950a62ff0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.820150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.820704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.820983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.821257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.828007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc435f-bdfe-4b40-8d83-68697dfbf791 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.829306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.831554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:14.843214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:14.844191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:14.845189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 493/969] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:14.852154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.870575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.871542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.872052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.872524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.880566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.882326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:14.895470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:14.896441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 14:01:14.897460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:14.904783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 477/970] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:14.905916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:14.958371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1593e7-c2ac-49b5-b991-9917065de758 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:14.994351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:14.995137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:14.995362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:14.995598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:14.996289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:14.996594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:14.998003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.016627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca924-b943-4417-88e3-6c2024e7a788 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.022734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.030629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.038396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 494/971] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:15.039056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.066713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.068421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.069431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.070268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.071536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:15.072096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.075095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.105646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 478/972] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 12 14:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:15.109802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.172123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391025d-103c-45c3-a666-167dd9618337 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.218511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.219196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.219478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.219749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.220344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.221717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.230101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64da5-c5d8-4901-b435-91695ec29543 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:15.230955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:15.231999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:15.233042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 495/973] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:15.241014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.276676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.278018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.278486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.279051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.315189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.329830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.362103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.363957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.366029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171f2cc-8d80-4930-a666-a2dea3397716 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.408644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.409266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.409526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.409801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.410432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:15.410884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.412126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.417646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 496/974] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:15.422639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.472852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 479/975] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:15.477977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.529022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c510-c4c7-4285-88ec-56cc446610e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.546911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.557660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.566307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.566919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.567230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.567507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.568141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:15.568536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.569901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.575482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 497/976] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:15.580704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.584728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380788c-26a5-49e3-8c0d-4bbf5a329c5d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.621492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.622151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.622451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.622724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.633346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.634809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:15.649881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:15.650882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:15.656840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:15.656840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:15.656840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:15.656840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 480/977] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:15.656840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.692806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00b469-d6df-4afa-955b-f54c480b0ef2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.725450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.726150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.726773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.727144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.727885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.729830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f120ad-1d10-4949-99dd-9a128efc59ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.750214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 498/978] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:15.751530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac590a-cd5d-4a66-8361-f6fefe3cf78c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.751826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac590a-cd5d-4a66-8361-f6fefe3cf78c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.752105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac590a-cd5d-4a66-8361-f6fefe3cf78c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.753510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 499/979] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:15.759289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.759572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.759844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.764232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044260b-2f90-426f-b639-9a6c79025130 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.779658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:15.780894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:15.790754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.811743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.812374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.812654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.812922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.813604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:15.813907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.815349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:15.828443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 481/980] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:15.834069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:15.836698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:15.867397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 500/981] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:15.945175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99521-6822-43b3-ba14-e1ddc47a4e0c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:15.979316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:15.979953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:15.980233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:15.980500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:15.986987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:15.988782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:16.001165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:16.002233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:16.003608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 482/982] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:16.008165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.113436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f21f2-364e-4030-90b2-72f2763cda6e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.134675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.155568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.156274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.156624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.156968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.157728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:16.158108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.159630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.175889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 501/983] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:16.176864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.183641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:16.213457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:16.250588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e56c-1ae7-430a-9036-f7670461e404 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.282936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2cffd-cc66-4ce1-8df4-cdfc4e42f527 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.287094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.287827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.288197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.288558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.289236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.290694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:16.299655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:16.300972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:16.301868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 483/984] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:16.307990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.320813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.321424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.321703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.321973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.323276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] RBAC: Adding query filter params (role.id=e9ccd6a06dd0407cb45d35a4489fd65e, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=f89941d577024d3e93977851c85e05d8) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:16.323582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.325106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.330657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 502/985] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/role_assignments?user.id=f89941d577024d3e93977851c85e05d8&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=e9ccd6a06dd0407cb45d35a4489fd65e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:16.427562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092bb1-bd22-4991-a0a9-18871acd44f7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.429145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:16.465916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.466621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.466964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.467321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.468019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:16.468389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.469858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.479510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 484/986] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:16.482241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.582244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:16.585949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d574e-5849-4c55-aa41-8f6940742d16 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.621438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.622049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.622332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.622605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.623267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:16.623572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.624924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.629990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 503/987] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:16.636004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.739812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245aa40-3380-455b-be4b-a9da3366d785 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.773802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.774407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.774682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.774949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.776209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] RBAC: Adding query filter params (interface=public, service_id=edda9a52764a4c5a98c18feed32cf791, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:16.776517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.777882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44bfac-1ebf-4f88-b955-10b6f6ca27d5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.787936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 485/988] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/endpoints?service_id=edda9a52764a4c5a98c18feed32cf791&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:16.788914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:16.892602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d610241-d592-4db8-a1b6-b1352d826e9c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:16.927141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:16.927751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:16.928025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:16.928293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:16.928891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:16.930296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d82dc-eae9-4be1-bd05-783e8af0579f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:16.937172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 504/989] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:16 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:01:17.928474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0b16-e22d-444b-b36e-9d6cc78c72ba None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:17.929025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0b16-e22d-444b-b36e-9d6cc78c72ba None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:17.929025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0b16-e22d-444b-b36e-9d6cc78c72ba None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:17.930488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 486/990] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:17.936215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:17.936597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:17.936765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:17.955141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:17.956319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:17.978338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:18.023334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 505/991] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:18.295269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0b16-e22d-444b-b36e-9d6cc78c72ba None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:18.326411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:18.400450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0b16-e22d-444b-b36e-9d6cc78c72ba None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:18.433951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:18.434610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.434888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.435190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.435798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:18.437229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4c555759-724c-43e7-b639-459a9d70d5c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:18.446984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:18.448099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:18.448972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:18.451119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 487/992] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:18.454778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:18.554322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0455-d32b-47d3-8cda-56d495fbbb07 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:18.561835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c38d1-7213-4574-8b8c-621de2f16574 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.562121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c38d1-7213-4574-8b8c-621de2f16574 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.562397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c38d1-7213-4574-8b8c-621de2f16574 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.564043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 488/993] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:18.568905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.569191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.569468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.586879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:18.588643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:18.589175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:18.589781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.590059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.590328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.591091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:18.591436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:18.592798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:18.597758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 506/994] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:18.603784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:18.628593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:18.661740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 489/995] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:18.708309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08da83-ea86-4cae-b409-f1d898df4904 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:18.741643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:18.742249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.742527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.742795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.743444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:18.743747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:18.745123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:18.750005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 507/996] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:18.755839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:18.783116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:18.858998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa5ce-c42f-47f0-9f0d-da9978a7c479 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:18.893294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:18.893903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:18.894178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:18.894445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:18.895179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] RBAC: Adding query filter params (interface=admin, service_id=ec532d8db1a041f9a8affeb0ca26e0a9, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:18.895485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:18.896848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:18.907059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 490/997] 10.222.0.20 () {56 vars in 1249 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/endpoints?service_id=ec532d8db1a041f9a8affeb0ca26e0a9&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:18.908635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:18.929332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.004678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:19.021306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26291-5ac2-45c2-ba89-16b59f44c7ad None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.033120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:19.046222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae163-2164-4a11-b6cc-bb5787ad889b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.059666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.060274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.060554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.060822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.061428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.062807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1a17b-92d6-42ee-bc9d-1d3c5f4c8654 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.070106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 508/998] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:01:19.071295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eaff-7bba-4623-ae90-ecb7f463ec3e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.071572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eaff-7bba-4623-ae90-ecb7f463ec3e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.071842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eaff-7bba-4623-ae90-ecb7f463ec3e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.073593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 509/999] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:19.079120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb30a-2320-473f-be12-402231add59f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.079417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb30a-2320-473f-be12-402231add59f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.079666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb30a-2320-473f-be12-402231add59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.089935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.090591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.090873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.091196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.091797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.093216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.101029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7c0fb30a-2320-473f-be12-402231add59f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:19.102246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c0fb30a-2320-473f-be12-402231add59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:19.102970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:19.104681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:19.105563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.110092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 491/1000] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 12 14:01:18 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:19.111086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.186675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 510/1001] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:19.229675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c83e9-be82-40ba-af0b-7a2e1a9754e0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.268357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.268979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.269246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.269520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.270148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] RBAC: Adding query filter params (name=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:19.270451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.271877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.277695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 492/1002] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:19.283413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb30a-2320-473f-be12-402231add59f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.360679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:19.380673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb30a-2320-473f-be12-402231add59f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.414068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.414678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.414957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.415257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.415891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:19.416705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.418063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.431393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 511/1003] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:19.459196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.479498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:19.571846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d07f2-d9e1-4bba-9513-0b9569666251 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.610796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.611380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.611658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.611932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.612499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.614121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:19.623010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:19.624056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:19.624920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 493/1004] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:19.629938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.730712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334224-5116-4e34-96d3-cc1be9210cd9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.764794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.765403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.765682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.765952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.766578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:19.766878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.768261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.778555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 512/1005] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:19.779528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.873034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:19.894506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b021f9-006b-45ec-aca6-bbb113693658 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:19.932831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:19.933458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:19.933705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:19.933982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:19.934605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:19.934909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:19.936317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283f98c-61b8-4458-885f-d0b873a631a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:19.945907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 494/1006] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 12 14:01:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:19.946932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:19.959574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:20.049585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361e36-055a-4d9c-a8e4-f63ddd78f9f4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:20.082945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:20.083568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:20.083844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:20.084109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:20.084765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:20.086106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d825-8b52-4754-817c-d22e3daab0a8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:20.111080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 513/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:01:21.245910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f480c7-4302-488c-b997-8f530435f818 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.246427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f480c7-4302-488c-b997-8f530435f818 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.246427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f480c7-4302-488c-b997-8f530435f818 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.247848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 495/1008] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:21.253101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43a72-3f79-4643-8a97-efb7d5eca293 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.253528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43a72-3f79-4643-8a97-efb7d5eca293 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.253703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43a72-3f79-4643-8a97-efb7d5eca293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.272047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a3f43a72-3f79-4643-8a97-efb7d5eca293 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:21.273217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a3f43a72-3f79-4643-8a97-efb7d5eca293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:21.333261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:21.349427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 514/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:21 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:21.613340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f480c7-4302-488c-b997-8f530435f818 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:21.624532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de019f5-72de-46e5-8518-f49ab8865ccc None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.625304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de019f5-72de-46e5-8518-f49ab8865ccc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.625590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de019f5-72de-46e5-8518-f49ab8865ccc None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.627334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 515/1010] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:21.632179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.632459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.632743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.651199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:21.652380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:21.721369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f480c7-4302-488c-b997-8f530435f818 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:21.725121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 516/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:21 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:21.758080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:21.758704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.758979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.759296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.759899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:21.761285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:21.770071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:21.771377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 14:01:21.772508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:21.773616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 496/1012] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 12 14:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:21.777036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:21.878604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae9f1c-d4ca-44c3-9047-a316eb77ab0b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:21.898597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:21.914704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:21.915347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:21.915626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:21.915896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:21.916564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:21.916866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:21.918221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:21.927081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 517/1013] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:21.929074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:21.941135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:22.003393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:22.035522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0fa09-62f8-477a-9db5-a09ba9654d55 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:22.070780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:22.071421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.071703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.071975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.073140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:22.073438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:22.075070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:22.079870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 497/1014] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 12 14:01:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:22.085332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:22.109095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed0c4-8b44-4097-bd84-703bf45c5869 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:22.149401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:22.150047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.150330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.150762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.151515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:22.153008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270250c6-fb22-40ae-857a-1222d3589d98 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:22.164770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:22.175091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 518/1015] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:22 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:01:22.204947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616c18-b119-474e-ac6d-137e48c998da None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:22.253717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:22.254353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.254593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.254866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.255587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:22.256995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ee568-537a-4c0f-aacb-e86f04b9e1dd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:22.275742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 498/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:01:22.342983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ee2d-3798-40d8-b588-979db8dcffa2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.343556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ee2d-3798-40d8-b588-979db8dcffa2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.343556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ee2d-3798-40d8-b588-979db8dcffa2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.345090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 519/1017] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:22.350723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.351020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.351318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.372326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:22.373554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:22.457053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 499/1018] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:22.721182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ee2d-3798-40d8-b588-979db8dcffa2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:22.770718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:22.828278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ee2d-3798-40d8-b588-979db8dcffa2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:22.870756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:22.871436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:22.871715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:22.871986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:22.882504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:22.887489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:22.888425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:22.889295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:22.893614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 520/1019] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:22.894853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:22.952106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:23.000322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e702-836b-41c3-a03c-b470ca175c1d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.034645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.035288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.035579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.035856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.036529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:23.036836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.038213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.051552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 500/1020] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:23.053259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:23.164461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7305b2f-1f1a-4e41-8666-49ff94a787d6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.167929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:23.201944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.202575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.202854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.203159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.214015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.215658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:23.229481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:23.230428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:23.231725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:23.231725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:23.231725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:23.235095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 521/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:23.236547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:23.342779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b869-4eb1-4604-9943-2b96641c6fac None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.358578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:23.378099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.378707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.378986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.379295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.379933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:23.380237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.381602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.398050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 501/1022] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:23.399657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:23.500551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b0cc-6dbc-4f4b-9654-bceea66f544e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.534260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.534879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.535185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.535457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.542821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.544270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:23.555217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:23.556148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:23.557646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 522/1023] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:01:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:23.562996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:23.663126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077dc50-2969-414b-ab8c-0160431de59e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.696256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.696853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.697131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.697954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.698675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:23.698975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.700425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.716985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 502/1024] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:01:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:23.722706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:23.741386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:23.824748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e69af-f96a-4b1f-9f16-fec872fe2411 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:23.863572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:23.864186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:23.864461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:23.864731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:23.931701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:23.933554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:23.950924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.037211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 523/1025] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 14:01:24.039023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.073273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.155172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d29f-2720-424b-b7d6-3477395cc80c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.190185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.190732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.191006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.191302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.201270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.202710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f51d831e-efed-4760-80bd-bed2216ff5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:24.216916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:24.217894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:24.223603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:24.223603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:24.223603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:24.223603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 503/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:24.225581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.328528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9478c0-a7a6-4983-a510-03271f340780 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.347670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.361072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7beb-eea0-493c-a1b4-8dd265be943d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.361641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7beb-eea0-493c-a1b4-8dd265be943d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.361641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7beb-eea0-493c-a1b4-8dd265be943d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.362938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 504/1027] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:24.368476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79143-0af2-4e7f-b93f-abdb81759f40 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.368761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79143-0af2-4e7f-b93f-abdb81759f40 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.369080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79143-0af2-4e7f-b93f-abdb81759f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.369985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.370588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.370866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.371163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.371804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:24.372104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.373437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.389970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 524/1028] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:24.390172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6ed79143-0af2-4e7f-b93f-abdb81759f40 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:24.390172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ed79143-0af2-4e7f-b93f-abdb81759f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:24.391976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.459638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 505/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:24.460904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998044a-95cd-4231-bb27-d165dae8d11b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.461251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998044a-95cd-4231-bb27-d165dae8d11b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.461584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998044a-95cd-4231-bb27-d165dae8d11b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.463548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 506/1030] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:24.468431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.468714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.468990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.486893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:24.488566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:24.501591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32277ad4-9726-45f4-b6c7-534cc7eace69 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.502121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.538457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.539136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.539419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.539694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.548339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.550006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.560376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 507/1031] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:24.562550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:24.563471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:24.564378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 525/1032] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:24.569394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.669775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aead3d-2660-47a5-9772-b5139d78c6b9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.703700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.704423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.704797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.705162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.705940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:24.706340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.707889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.720107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 508/1033] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:24.725848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.736393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.746874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.763592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.832506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa96192-c8bb-4bb2-8323-c335bde93e4c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.842189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9573f-620f-47d4-bc87-6903f9cb4959 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:24.866268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.866870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.867182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.867457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.868187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] RBAC: Adding query filter params (role.id=e9ccd6a06dd0407cb45d35a4489fd65e, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:24.868492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.869960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.875272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:24.875491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 526/1034] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=e9ccd6a06dd0407cb45d35a4489fd65e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:24.875785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:24.875883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.876068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:24.876395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] PATH_INFO: `/v3/services/image` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:24.876971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:24.878345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:24.896490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:24.897596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:24.898443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 509/1035] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:24.904487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:24.982807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.995303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:24.999092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc476-971e-44c2-98eb-01ebded0b128 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.018355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f5a9-a195-41ac-a43f-22c39b6135eb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.038426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.039096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.039381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.039660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.040772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.042230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.043859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 527/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:25.049619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:25.059922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.061464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.061464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.061464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.061702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] RBAC: Adding query filter params (name=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:25.061980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.063438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.075964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 510/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:25.081412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:25.170149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449623a-6f71-415f-b5ba-c4501c716420 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.194242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081c70f-23ae-48c3-a9a2-569fb3a89592 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.207819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.208435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.208720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.209144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.210181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.211655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.230336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.231077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.231432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.231651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.232414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:25.232722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.234247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.236326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:25.240317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 511/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:25.255061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 528/1039] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:25 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:25.255282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:25.366098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e921-5aee-4a34-bc6f-c067b7dbeaf0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.405508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.406137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.406417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.406690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.407441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] RBAC: Adding query filter params (interface=public, service_id=00dbf9b8fbfb4fa8bd94ba87f7e6b0f3, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:25.407751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.409149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ebdd-d66c-4e7e-9fa7-347659d038a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.419273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 512/1040] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:01:25 2022] GET /identity/v3/endpoints?service_id=00dbf9b8fbfb4fa8bd94ba87f7e6b0f3&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:25.420988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:25.444779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:25.536769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb383-fba6-4462-94d7-d1670afb620a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:25.572047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:25.572690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:25.572971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:25.573244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:25.573857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:25.575251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ce941-d5af-45e0-8f21-c210545c082f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:25.591059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 529/1041] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:01:25 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:01:27.012679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104b12-57e4-4019-a5ce-7b1d4ab81ef2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.013228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104b12-57e4-4019-a5ce-7b1d4ab81ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.013228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104b12-57e4-4019-a5ce-7b1d4ab81ef2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.014683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 513/1042] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:27.019656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.020028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.020209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.037791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:27.038958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:27.104795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 530/1043] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:27.370614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104b12-57e4-4019-a5ce-7b1d4ab81ef2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:27.435594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:27.480683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104b12-57e4-4019-a5ce-7b1d4ab81ef2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:27.514366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:27.514993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.515297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.515622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.525974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-369e18cf-979f-4e09-b34e-7ed289201352 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:27.530801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:27.531729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:27.532613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:27.535431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 514/1044] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:27.537775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:27.540533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb6c-7778-4392-9800-3e3f1f424f98 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.540818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb6c-7778-4392-9800-3e3f1f424f98 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.541687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207fb6c-7778-4392-9800-3e3f1f424f98 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.543694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 515/1045] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:27.548485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.548768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.549135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.556963 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:27.567902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:27.569088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:27.643525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 516/1046] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:27.669072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b351-3b74-459e-ae88-60e2ae1dc012 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:27.711302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:27.711912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.712194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.712463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.713693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:27.713992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:27.715364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8f99-41f8-45b9-8988-f2e987039658 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:27.728384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 531/1047] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:27.729364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:27.764075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302c51-71b3-4e8e-b686-f5affb97a2ac None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.764353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302c51-71b3-4e8e-b686-f5affb97a2ac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.764633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302c51-71b3-4e8e-b686-f5affb97a2ac None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.765983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 532/1048] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:27.770921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.771246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.771528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.786853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:27.790371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:27.791620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:27.842199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56aee-391a-412a-9a9e-c79b7151fdbb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:27.863009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 533/1049] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:27.878830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:27.879743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:27.880199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:27.880646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:27.891778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:27.893437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:27.908739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:27.909662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:27.910565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:27.910565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:27.910565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:27.911296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 517/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:27.918047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:27.920240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:27.924011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.032219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e457-8891-4c6e-9c2d-2c355b76917c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.032761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e444-6250-407d-b5c5-5fd1a7d97aa7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.035461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.068123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.068299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.068786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.069064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.069336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.069817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.069990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:28.070265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.070649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.071181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.071683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.073311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.075056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.081264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 518/1051] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:28.082239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.088209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 534/1052] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:28.089052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.160612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.194852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570889-10c5-4109-ac9c-7f539f0861a3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.197670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176774d7-89df-4f58-a486-34eb57ec4932 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.227678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.228329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.228607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.228878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.229149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.229743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.230017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.230285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.230922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.232375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.236059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.237466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:28.249299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:28.250332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 535/1053] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:28.251401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.260204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 519/1054] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:01:28 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:28.260890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.297218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.371450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96e23-a766-47f8-8f41-efd7dd72969e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.390409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4668953-1cb9-43c1-bd02-372baee1e13a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.399551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.409856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.410591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.410983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.411289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] PATH_INFO: `/v3/services/image` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.411947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.413350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:28.423713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:28.425042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:28.426087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 536/1055] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:28.430732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.438583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.439267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.439548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.439817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.440768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:28.440879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.442393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.462495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 520/1056] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:28.468401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.546617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8b93-fa99-4b16-bce3-552011b8dc22 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.566229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.582351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e659-6d28-4b3b-8534-17b5c7f84679 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.582550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.582996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.583301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.583570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.584352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:28.584655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.586810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.596770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 537/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:28.597663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.622439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.623274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.623543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.623867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.635755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.637351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.655735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:28.657672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:28.658890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:28.660070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:28.660070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:28.660070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:28.663554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 521/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:28.664562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.705351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d37-463f-4b79-8afc-413a51b7785b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.741890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.742490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.742767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.743049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.743680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:28.744520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.745864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.750862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 538/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:28.756287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.769605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc94f8-d5f1-4e9c-a081-d7e006fd5e5f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.805237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.805904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.806179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.806986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.807656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:28.807958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.810185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.816339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.827367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 522/1060] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:28.828414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:28.867228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7295ef9-f972-4576-a119-62e0719ea2c8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.885865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:28.904801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.907523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.908429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.908785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:28.910889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:28.912306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:28.947715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 539/1061] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:01:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:01:28.951645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd078-f3bf-4038-890a-5434aba60575 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:28.997624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:28.998484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:28.998842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:28.999239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:29.007370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:29.009012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:29.022074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:29.023269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:29.024400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:29.025779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 523/1062] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:29.031710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:29.144866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ed1e2-0fa4-4611-9b6d-3579145decc2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:29.178693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:29.179342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:29.179622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:29.179893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:29.180587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:29.180891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:29.182857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003fde9-4d5c-4056-8c07-1cf9262e6acb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:29.195115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 540/1063] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:29.201371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:29.259673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:29.305158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167810-e05b-4e27-9b11-9dbf04b750c8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:29.339169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:29.340135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:29.340596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:29.341063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/e9ccd6a06dd0407cb45d35a4489fd65e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:29.343388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=c91855d376b741ef957a6352eedee1a5, role_id=e9ccd6a06dd0407cb45d35a4489fd65e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:29.345008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda01ee-d6b6-4b24-a132-636ee1f9eabc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:29.360410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 524/1064] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:01:29 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/c91855d376b741ef957a6352eedee1a5/roles/e9ccd6a06dd0407cb45d35a4489fd65e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:01:30.490242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822b8e-a8dd-40c6-af91-40d5490254d9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:30.490747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822b8e-a8dd-40c6-af91-40d5490254d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:30.490827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822b8e-a8dd-40c6-af91-40d5490254d9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:30.492327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 541/1065] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:30.497388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:30.497789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:30.497998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:30.517067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:30.518295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:30.586477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 525/1066] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:30.854319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822b8e-a8dd-40c6-af91-40d5490254d9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:30.891011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:30.961758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822b8e-a8dd-40c6-af91-40d5490254d9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:30.996434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:30.997102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:30.997377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:30.997648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.010429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8fb180e8-1134-47e6-a707-a92822f61891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:31.015546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:31.016584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:31.017519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:31.019434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 542/1067] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:31.022890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.070926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.119953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f847-6ad8-414f-b3de-59430644c061 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.120244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f847-6ad8-414f-b3de-59430644c061 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.120524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f847-6ad8-414f-b3de-59430644c061 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.122453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 543/1068] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:31.127705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.127995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.128272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.138871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e014-037b-41ba-8732-f9f08e2d82e7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.146036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:31.147259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:31.185902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.186848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.187374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.187841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.188695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:31.189190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.191213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.201669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 526/1069] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:31.207429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.221191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 544/1070] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:31.306136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a924573-591c-416b-8990-02ab2875d538 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.313417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.341294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.341924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.342199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.342467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] PATH_INFO: `/v3/users/52091b425e024d70bb648b9c81f80817` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.355984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] RBAC: Authorizing `identity:get_user(user_id=52091b425e024d70bb648b9c81f80817)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.357420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.363924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 527/1071] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/users/52091b425e024d70bb648b9c81f80817 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:31.365107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.392232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.472383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83725218-6601-454a-a3a7-98774c2701f0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.506850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.507536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.507999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.508105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.508972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.573822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.575287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47338-c508-4412-b966-e9982d83b392 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.598226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.608038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f613-a18f-4171-b069-b3da5e01ecde None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.642590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.643149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.643426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.643705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.673386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.673709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 545/1072] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:31.675036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bacdc-0d25-402e-9198-635d49076f1f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.675335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bacdc-0d25-402e-9198-635d49076f1f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.675612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bacdc-0d25-402e-9198-635d49076f1f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.677434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 546/1073] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:31.682526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bacdc-0d25-402e-9198-635d49076f1f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.710126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.711805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2daa39-3ce2-449f-b6d0-87fd898df5aa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.782142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bacdc-0d25-402e-9198-635d49076f1f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.806357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.810771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 528/1074] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 14:01:31.812209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.812502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.812778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.817661 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.818286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.818563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.819006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.820918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.822385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.827083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 547/1075] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:31.827083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.830432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:31.831645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:31.888763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:31.897296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 529/1076] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:31.898026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:31.927742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237e09-a412-4704-9826-5786e5174840 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:31.962875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:31.963532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:31.963817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:31.964090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:31.974375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:31.975840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:31.991823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:31.992766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:31.994212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:31.994212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:31.994212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:31.994212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 548/1077] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:31.999422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.012174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37bfd-f522-492a-acf9-7d0aee1af01d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.046782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:32.046933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.047422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.047915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.048025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.048690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user.id=52091b425e024d70bb648b9c81f80817) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:32.049001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.050498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.055880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 530/1078] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/role_assignments?user.id=52091b425e024d70bb648b9c81f80817&scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:32.124874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bab20-344f-4235-84a3-f463f317a730 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.162770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.163338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.163620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.163907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.164578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:32.164885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.166845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.171445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.181174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 549/1079] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:32.240307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:32.291963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99579-5180-485d-bd10-9c4b34a44329 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.330027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.330676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.330955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.331255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.343576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:32.348556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:32.349487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 14:01:32.350334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:32.355451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 531/1080] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 12 14:01:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:32.356796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.465934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918c0e-281a-422a-a0d8-12de3f042a06 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.468238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:32.503198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.503818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.504101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.504377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.505060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:32.505351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.506727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.516208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 550/1081] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:01:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:32.522565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.621644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f015a5-8518-42dc-9310-b855025bc4f8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.638215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:32.655763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.656388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.656662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.656929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.667545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.668980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:32.682467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:32.683480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:32.684446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:32.684446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:32.684446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:32.684446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 532/1082] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:32.689478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.786538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6e1a-97c0-41fc-aa1e-184df79637e7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.819274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.819873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.820155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.820429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.821070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:32.821374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.822769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.834822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 551/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:32.840963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:32.941737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e6a7-5cbb-43a5-ace6-91ce9f9d5c62 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:32.976016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:32.976642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:32.976920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:32.977196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:32.984421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:32.985861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:01:32.996883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:32.998031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:32.999001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 533/1084] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 12 14:01:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:01:33.003876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:33.030939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.101002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917f0b4-80cd-47f1-ac74-6e170955e919 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:33.134796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:33.135437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:33.135718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:33.135990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:33.136717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:33.137023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:33.138447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:33.155500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 552/1085] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:33.161163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:33.191011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.259826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8de8b-8d3e-44d1-9da9-91e66bd243a4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:33.292775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:33.293382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:33.293659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:33.293927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:33.361491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:33.362874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:33.391800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.460456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 534/1086] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 14:01:33.466198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:33.546687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.562725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910828b8-784a-4042-b6ac-3781ba7357fa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:33.595892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:33.596518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:33.596799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:33.597072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:33.606849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:33.608317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:01:33.627876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:33.629420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:01:33.631480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:01:33.631480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:01:33.631480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:33.631480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 553/1087] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:33.635209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:33.738643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3f83-770b-4cda-a971-78491dd716f7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:33.767498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.773466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:33.774071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:33.774350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:33.774620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:33.775310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:33.775613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:33.776980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:33.788641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 535/1088] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:33.794982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:33.889772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e8b3-5c72-4bd8-8e5a-0742eaaee05d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:33.921648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:33.922268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:33.922544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:33.922812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:33.925444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:33.930193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:33.932820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:01:33.943735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:33.944769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:33.946044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 554/1089] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:33.950679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:34.048422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11705d6-cd89-449a-8889-2f0136e37cbc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:34.082501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:34.083175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.083457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.083745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.084437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:34.084743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:34.086223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53772f7e-d4be-4d53-8eb5-7dee83f3dcff None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:34.099781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 536/1090] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:34.106572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:34.184817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f480-5ed5-45d8-8d42-bf97ccee81a9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.185030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f480-5ed5-45d8-8d42-bf97ccee81a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.185305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f480-5ed5-45d8-8d42-bf97ccee81a9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.186680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 537/1091] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:01:34.191668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.191956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.192232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.204597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685099f-b1c4-4af7-8405-f0c2e2595757 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:34.210374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:34.211582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:34.238247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:34.238850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.239152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.239424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.240142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] RBAC: Adding query filter params (role.id=e9ccd6a06dd0407cb45d35a4489fd65e, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=c91855d376b741ef957a6352eedee1a5) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:34.240444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:34.241852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:34.247497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 555/1092] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:34 2022] GET /identity/v3/role_assignments?user.id=c91855d376b741ef957a6352eedee1a5&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=e9ccd6a06dd0407cb45d35a4489fd65e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:34.259542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:34.282687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 538/1093] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:34.549521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:34.609969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:34.652544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1f9-a0f7-40f4-a456-4ae30778220c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:34.686265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:34.686960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.687268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.687538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.697893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:34.702673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:34.703723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:01:34.704578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 556/1094] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:34.709980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:34.810836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18322-5a72-46c2-9f55-bc2237580033 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:34.844905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:34.845516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.845795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.846064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.846729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:34.847023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:34.848413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:34.857075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 539/1095] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:34.862904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:34.962187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0df00-8360-4546-9c26-d98d335b5853 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:34.981962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:34.997328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:34.997959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:34.998238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:34.998507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] PATH_INFO: `/v3/users/52091b425e024d70bb648b9c81f80817` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:34.999632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] RBAC: Authorizing `identity:get_user(user_id=52091b425e024d70bb648b9c81f80817)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:35.001057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:35.002636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 557/1096] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:34 2022] GET /identity/v3/users/52091b425e024d70bb648b9c81f80817 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:35.008396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:35.052235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:35.116832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd47f-a09c-445c-81f5-8a1184fd08c2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:35.151078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:35.151708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:35.151982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:35.152248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:35.153340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:35.154759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43ce3d-1cbf-4be7-92bb-c7a2b6543786 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:35.156427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 540/1097] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:35 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:35.162409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:35.258706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73febe-7838-4444-af4f-c991d143a3ab None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:35.290018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:35.291190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:35.291474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:35.291744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc/users/52091b425e024d70bb648b9c81f80817/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:35.293606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user_id=52091b425e024d70bb648b9c81f80817, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:35.295009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a009-2f53-454f-ae6a-8dd800932719 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:35.307926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 558/1098] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:01:35 2022] PUT /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc/users/52091b425e024d70bb648b9c81f80817/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:01:37.426534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40961-99c1-4ffe-a45f-4ff1047248dd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:37.427078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40961-99c1-4ffe-a45f-4ff1047248dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:37.427078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40961-99c1-4ffe-a45f-4ff1047248dd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:37.428374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 541/1099] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:37.434209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:37.434593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:37.434755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:37.452428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:37.453599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:37.495712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:37.518011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 559/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:37.784387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40961-99c1-4ffe-a45f-4ff1047248dd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:37.883272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40961-99c1-4ffe-a45f-4ff1047248dd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:37.893485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:37.917658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:37.918277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:37.918551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:37.918818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:37.928551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:37.933378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:37.934495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:37.935616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 542/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:37.940632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:38.035359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333f74-9462-41e9-afa6-f1cd66936591 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:38.067199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:38.067789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:38.068065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:38.068331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:38.068980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:38.069282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:38.070620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:38.078179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 560/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:38.084014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:38.180874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8350-9d56-4112-bc96-67256d461bb4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:38.214381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:38.215000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:38.215309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:38.215584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] PATH_INFO: `/v3/users/52091b425e024d70bb648b9c81f80817` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:38.216688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=52091b425e024d70bb648b9c81f80817)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:38.218113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:38.219709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 543/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:38 2022] GET /identity/v3/users/52091b425e024d70bb648b9c81f80817 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:38.225531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:38.266655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:38.323768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459feac-265c-497c-b21f-b5264b646547 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:38.357017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:38.357608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:38.357886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:38.358163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:38.421803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:38.423254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:38.460763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:38.517325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 561/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:38.523330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:38.562892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:38.620867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec189d-b67c-4d07-8362-915e47c6f0b0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:38.653248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:38.653868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:38.654145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:38.654416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:38.655529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:38.656962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549468-5901-4ed8-a257-ae0e95708877 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:38.658551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 544/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:38 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:38.664556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:38.758576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236f348-1ee3-41b6-9172-576d3fc770c5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:38.790819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:38.791434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:38.791715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:38.791987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:38.792702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user.id=52091b425e024d70bb648b9c81f80817) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:38.793007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:38.794412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757e18-b3c3-4cdf-adf9-c9876c3f8773 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:38.799934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 562/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:38 2022] GET /identity/v3/role_assignments?user.id=52091b425e024d70bb648b9c81f80817&scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:40.928558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb2d7a-8e7a-4609-81f3-21a831fd2414 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:40.929137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb2d7a-8e7a-4609-81f3-21a831fd2414 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:40.929137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb2d7a-8e7a-4609-81f3-21a831fd2414 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:40.930479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 545/1107] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:40.935700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:40.936112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:40.936248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:40.943361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:40.954512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:40.955703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:41.021925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 563/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:41.290815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb2d7a-8e7a-4609-81f3-21a831fd2414 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:41.392560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb2d7a-8e7a-4609-81f3-21a831fd2414 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:41.400515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:41.426128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:41.426740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:41.427014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:41.427303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:41.428393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:41.429820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6506-93ec-49e7-9436-c9eda9352bd7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:41.431404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 546/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:41.437298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:41.532244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6d97-c7d1-41c8-8a77-94bf1c5402e9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:41.564383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:41.564915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:41.565191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:41.565461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:41.566095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:41.567538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0057-655a-4220-b950-79e64686e35a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:41.575443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:41.589543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 564/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:01:41 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:43.782447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb8a23-e917-4c13-8b21-7e29faee175e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:43.782991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb8a23-e917-4c13-8b21-7e29faee175e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:43.782991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb8a23-e917-4c13-8b21-7e29faee175e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:43.784369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 547/1111] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:43.789750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:43.790170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:43.790296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:43.808362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:43.809533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:43.873049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 565/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:44.144196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb8a23-e917-4c13-8b21-7e29faee175e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:44.243192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb8a23-e917-4c13-8b21-7e29faee175e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:44.276613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:44.277287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:44.277563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:44.277832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] PATH_INFO: `/v3/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:44.279228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] RBAC: Authorizing `identity:get_role(role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:44.280590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:44.281896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 548/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:44 2022] GET /identity/v3/roles/22655a77c5404228b6c11450a3edffc1 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:44.287853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:44.383606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad1887-bd90-4045-9e33-4c96a8e27d9c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:44.402371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:44.417286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:44.417909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:44.418185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:44.418455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] PATH_INFO: `/v3/users/6756cdfeba714099aea2228414c0b14d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:44.431588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6756cdfeba714099aea2228414c0b14d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:44.433001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:44.434557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 566/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:44 2022] GET /identity/v3/users/6756cdfeba714099aea2228414c0b14d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:44.440141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:44.481309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:44.535397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1fa4-273c-4b00-aff2-24af5be705c4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:44.567981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:44.568572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:44.568848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:44.569119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:44.632229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:44.633713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:44.673072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:44.726534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 549/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:44.732985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:44.827158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329a97-7099-4221-b605-db339f8511a2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:44.858602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:44.859235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:44.859518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:44.859794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:44.860891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:44.862298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a5d13-7894-4056-a611-2259ef702e5d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:44.864186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 567/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:44 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:44.870468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:44.965035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aef8-084f-468c-824b-4519fbe5a3de None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:44.998827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:44.999447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:44.999726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:44.999996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:45.000710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user.id=6756cdfeba714099aea2228414c0b14d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:45.001013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:45.002429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a4be-6c5b-4e5b-bc66-2d2eb2386e86 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:45.007533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 550/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:44 2022] GET /identity/v3/role_assignments?user.id=6756cdfeba714099aea2228414c0b14d&scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc&role.id=22655a77c5404228b6c11450a3edffc1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:47.094227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075758f-76ea-4b2c-a36d-b10418536d46 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.094783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075758f-76ea-4b2c-a36d-b10418536d46 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.094783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075758f-76ea-4b2c-a36d-b10418536d46 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:47.096144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 568/1118] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:47.101136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.101550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.101676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:47.115202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:47.120839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:47.122009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:47.186311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 551/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:47.453646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075758f-76ea-4b2c-a36d-b10418536d46 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:47.499303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:47.550730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075758f-76ea-4b2c-a36d-b10418536d46 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:47.583398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:47.584006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.584281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.584550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] PATH_INFO: `/v3/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:47.585902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] RBAC: Authorizing `identity:get_role(role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:47.587303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:47.588587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 569/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:47 2022] GET /identity/v3/roles/22655a77c5404228b6c11450a3edffc1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:47.594311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:47.688843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4af9-e4f6-4747-99d0-86bdad823043 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:47.721198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:47.721818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.722095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.722365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] PATH_INFO: `/v3/users/6756cdfeba714099aea2228414c0b14d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:47.723489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] RBAC: Authorizing `identity:get_user(user_id=6756cdfeba714099aea2228414c0b14d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:47.724905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:47.726430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 552/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:47 2022] GET /identity/v3/users/6756cdfeba714099aea2228414c0b14d => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:47.732061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:47.826390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a560-5f7d-475e-a504-4ff8b59dacd2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:47.839432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:47.858657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:47.859289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.859566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.859836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:47.860917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:47.862332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d111129-cf9c-46bb-ae60-86bd1cb5987a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:47.864199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 570/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:47 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:47.870462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:47.874072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:47.965750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee75cd-1394-4e3f-8b93-eb90ee5d7333 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:47.998719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:47.999331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:47.999609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:47.999880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc/users/6756cdfeba714099aea2228414c0b14d/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:48.001962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user_id=6756cdfeba714099aea2228414c0b14d, role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:48.003405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905df51-0baa-4e37-b858-98f226c5c435 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:48.016063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 553/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:01:47 2022] PUT /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc/users/6756cdfeba714099aea2228414c0b14d/roles/22655a77c5404228b6c11450a3edffc1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:01:50.108204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1b0f-a8b7-423e-9279-93af73cc221a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:50.108727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1b0f-a8b7-423e-9279-93af73cc221a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:50.108727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1b0f-a8b7-423e-9279-93af73cc221a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:50.110099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 571/1124] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:50.115842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:50.116225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:50.116390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:50.134459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:50.135664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:50.192136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:50.201218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 554/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:50.467933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e1b0f-a8b7-423e-9279-93af73cc221a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:50.564051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e1b0f-a8b7-423e-9279-93af73cc221a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:50.596040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:50.596645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:50.596921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:50.597190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] PATH_INFO: `/v3/roles/22655a77c5404228b6c11450a3edffc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:50.598537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] RBAC: Authorizing `identity:get_role(role_id=22655a77c5404228b6c11450a3edffc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:50.599915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:50.601186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 572/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:50 2022] GET /identity/v3/roles/22655a77c5404228b6c11450a3edffc1 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:50.607764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:50.706438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad88b1-6b5c-4130-94ce-e8a0347b517c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:50.738731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:50.739385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:50.739668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:50.739939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] PATH_INFO: `/v3/users/6756cdfeba714099aea2228414c0b14d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:50.741048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6756cdfeba714099aea2228414c0b14d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:50.742483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:50.744591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 555/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:50 2022] GET /identity/v3/users/6756cdfeba714099aea2228414c0b14d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:50.750332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:50.797820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:50.845517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628b942-53ce-402d-ac9f-e2b19f9f30f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:50.878525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:50.879130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:50.879407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:50.879676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:50.942725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:50.944166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:50.989169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:51.041595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 573/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:01:51.047655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:51.106023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:51.144490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcccfd8-51df-49e3-b994-281d6070f7d2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:51.177661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:51.178284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:51.178561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:51.178829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] PATH_INFO: `/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:51.179962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] RBAC: Authorizing `identity:get_project(project_id=2bd7f6fed5714c5bbe2f79a88bbafbdc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:51.181999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a91690-ae2a-41ba-a4f5-d310fbd54568 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:51.183649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 556/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:01:51 2022] GET /identity/v3/projects/2bd7f6fed5714c5bbe2f79a88bbafbdc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:51.189712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:51.284426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad222be-a334-4765-8f17-cbace1c9322b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:51.320195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:51.320789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:51.321095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:51.321368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:51.322089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] RBAC: Adding query filter params (role.id=22655a77c5404228b6c11450a3edffc1, scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc, user.id=6756cdfeba714099aea2228414c0b14d) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:51.322396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:51.323842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c909-bcfa-428c-92ad-56d3b503082d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:51.329381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 574/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:01:51 2022] GET /identity/v3/role_assignments?user.id=6756cdfeba714099aea2228414c0b14d&scope.project.id=2bd7f6fed5714c5bbe2f79a88bbafbdc&role.id=22655a77c5404228b6c11450a3edffc1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:53.461851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b91f-5a32-40dc-ba0b-6dc2b9f5b8c6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:53.462351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b91f-5a32-40dc-ba0b-6dc2b9f5b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:53.462351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b91f-5a32-40dc-ba0b-6dc2b9f5b8c6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:53.463680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 557/1131] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:53.468881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:53.469262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:53.469421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:53.487439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:53.488864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:53.498452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:53.553800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 575/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:53.819842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b91f-5a32-40dc-ba0b-6dc2b9f5b8c6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:53.917460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b91f-5a32-40dc-ba0b-6dc2b9f5b8c6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:53.944002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:53.950419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:53.951053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:53.951335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:53.951606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:53.952689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:53.954113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf3dc-f0fb-4dbc-84d3-a8cf2d176926 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:53.955668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 558/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:53.961279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:54.055277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af357fc-3ea7-4da7-a785-204044b29caa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:54.088015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:54.088548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:54.088823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:54.089091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:54.089728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:54.091169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb739-6c30-4876-af29-4eba2ba3ef25 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:54.105481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:54.122517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 576/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:01:53 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:56.272027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc040-e84c-4507-a6b0-606f545457bd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:56.272536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc040-e84c-4507-a6b0-606f545457bd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:56.272622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc040-e84c-4507-a6b0-606f545457bd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:56.274478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 559/1135] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:56.279781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:56.280224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:56.280325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:56.299207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:56.300375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:56.363980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 577/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:01:56.635209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc040-e84c-4507-a6b0-606f545457bd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:56.740445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc040-e84c-4507-a6b0-606f545457bd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:56.773631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:56.774309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:56.774588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:56.774860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:56.775991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:56.777426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ed7c-df2a-4d6c-b5d0-a7b18cafd217 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:56.778982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 560/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:56.784856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:56.880074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140e6df-23b9-48be-b9de-8c50b2737377 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:56.904677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:56.913329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:56.913926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:56.914208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:56.915048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:56.915724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:56.917139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5de12c-3259-4c4a-aafc-a25c551f937a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:56.939039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 578/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:01:56 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:01:59.103368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172034f3-b152-47c3-b34b-e20894f7fd0a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:59.103923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172034f3-b152-47c3-b34b-e20894f7fd0a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:59.103923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172034f3-b152-47c3-b34b-e20894f7fd0a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:59.105294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 561/1139] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:01:59.110432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:59.110843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:59.110978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:59.129003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:01:59.130158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:01:59.193499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 579/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:01:59.473216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172034f3-b152-47c3-b34b-e20894f7fd0a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:59.540394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:59.576136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172034f3-b152-47c3-b34b-e20894f7fd0a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:59.608116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:59.608737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:59.609015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:59.609285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:59.619725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:01:59.624482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:01:59.625565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:01:59.626634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 562/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:01:59.631779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:59.726030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff446196-5ff5-4f35-aecd-304c8a053dfb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:59.738583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:59.760789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:59.761389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:59.761666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:59.761937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:59.762599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:01:59.762898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:59.764286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:59.771989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 580/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:01:59.777883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:01:59.874411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1564b-625d-43c2-b160-5e87219b2f48 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:01:59.899236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:01:59.907814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:01:59.908430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:01:59.908707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:01:59.908978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] PATH_INFO: `/v3/users/e7646b3f8b30463e98c7424fba6efedb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:01:59.921969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] RBAC: Authorizing `identity:get_user(user_id=e7646b3f8b30463e98c7424fba6efedb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:01:59.923432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:01:59.924992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 563/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:01:59 2022] GET /identity/v3/users/e7646b3f8b30463e98c7424fba6efedb => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:01:59.931473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:00.025721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67a4d-1097-4b6d-b115-77f92b8c7fc8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:00.058075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:00.058663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:00.058941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:00.059242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:00.098065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:00.123785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:00.125257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:00.217835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 581/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:01:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:02:00.223810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:00.320044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf18a-4ede-4e41-b63c-82a00800c31d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:00.353921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:00.354537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:00.354818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:00.355120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] PATH_INFO: `/v3/projects/24f41c614d8b4866bbb27a000664db43` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:00.356225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] RBAC: Authorizing `identity:get_project(project_id=24f41c614d8b4866bbb27a000664db43)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:00.357652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac211b35-799f-47b8-907a-49c8a6c50a5d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:00.359276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 564/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:00 2022] GET /identity/v3/projects/24f41c614d8b4866bbb27a000664db43 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:00.365499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:00.435785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:00.459415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e896f2-6ca9-4ea1-8c78-52442ac8aedb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:00.493257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:00.493846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:00.494129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:00.494398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:00.495143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=24f41c614d8b4866bbb27a000664db43, user.id=e7646b3f8b30463e98c7424fba6efedb) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:00.495449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:00.496841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b124da5-88f1-436d-99d2-a1645ccc94e8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:00.501944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 582/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:02:00 2022] GET /identity/v3/role_assignments?user.id=e7646b3f8b30463e98c7424fba6efedb&scope.project.id=24f41c614d8b4866bbb27a000664db43&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:02.588209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c59c9-bfb9-4ab5-9435-79b54d7f0d3e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:02.588738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c59c9-bfb9-4ab5-9435-79b54d7f0d3e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:02.588738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c59c9-bfb9-4ab5-9435-79b54d7f0d3e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:02.590066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 565/1147] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:02.595299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:02.595666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:02.595841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:02.613604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:02.614769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:02.677812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 583/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:02.950404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c59c9-bfb9-4ab5-9435-79b54d7f0d3e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:03.008574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:03.053998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c59c9-bfb9-4ab5-9435-79b54d7f0d3e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:03.087966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:03.088584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:03.088859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:03.089130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:03.098896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:02:03.104266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:03.105376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:02:03.106642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 566/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:03.111647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:03.175855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:03.208269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8e4d6-4681-4320-aaa7-5feddbd1a9a6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:03.241012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:03.241611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:03.241890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:03.242157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:03.243431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:03.243733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:03.245083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:03.252793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 584/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:03.259490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:03.358164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b05a-b58a-4316-9f57-9a2ac8deb14b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:03.371315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:03.391605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:03.392229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:03.392507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:03.392776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] PATH_INFO: `/v3/users/e7646b3f8b30463e98c7424fba6efedb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:03.393880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] RBAC: Authorizing `identity:get_user(user_id=e7646b3f8b30463e98c7424fba6efedb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:03.395338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:03.396936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 567/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:02:03 2022] GET /identity/v3/users/e7646b3f8b30463e98c7424fba6efedb => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:03.403520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:03.500220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f94c3-f303-4914-8796-52a029052af7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:03.527741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:03.533734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:03.534363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:03.534642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:03.534916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] PATH_INFO: `/v3/projects/24f41c614d8b4866bbb27a000664db43` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:03.536058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] RBAC: Authorizing `identity:get_project(project_id=24f41c614d8b4866bbb27a000664db43)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:03.537477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779243-cdd9-42bc-b770-c6b1ab05741b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:03.539128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 585/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:03 2022] GET /identity/v3/projects/24f41c614d8b4866bbb27a000664db43 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:03.545118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:03.644373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50690f8-c572-4858-86f5-be0df8229a99 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:03.677382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:03.678023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:03.678302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:03.678573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] PATH_INFO: `/v3/projects/24f41c614d8b4866bbb27a000664db43/users/e7646b3f8b30463e98c7424fba6efedb/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:03.681110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=24f41c614d8b4866bbb27a000664db43, user_id=e7646b3f8b30463e98c7424fba6efedb, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:03.682541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167df15-d379-4a0c-b77d-d146c1116f76 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:03.695233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 568/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:02:03 2022] PUT /identity/v3/projects/24f41c614d8b4866bbb27a000664db43/users/e7646b3f8b30463e98c7424fba6efedb/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:02:05.795230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15d4-34c6-4fb7-bc70-93901a6e8103 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:05.795822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15d4-34c6-4fb7-bc70-93901a6e8103 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:05.795822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f15d4-34c6-4fb7-bc70-93901a6e8103 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:05.797400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 586/1154] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:05.802837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:05.803305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:05.803421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:05.822281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:05.823493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:05.855932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:05.889327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 569/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:06.164666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f15d4-34c6-4fb7-bc70-93901a6e8103 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:06.261412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f15d4-34c6-4fb7-bc70-93901a6e8103 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:06.293383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:06.293992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:06.294268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:06.294536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:06.304447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:02:06.309238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:06.310401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:02:06.311695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 587/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:06.316113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:06.411107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e9fd-5f3d-4d17-84d7-ddbbf9a49424 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:06.443719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:06.444317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:06.444597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:06.444871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:06.445553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:06.445855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:06.447263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:06.454968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 570/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:06.460639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:06.516570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:06.557076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adacb-41d3-46cd-8228-a8451d2eeb09 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:06.588816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:06.589427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:06.589704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:06.589974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] PATH_INFO: `/v3/users/e7646b3f8b30463e98c7424fba6efedb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:06.591075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] RBAC: Authorizing `identity:get_user(user_id=e7646b3f8b30463e98c7424fba6efedb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:06.592478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:06.594006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 588/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:02:06 2022] GET /identity/v3/users/e7646b3f8b30463e98c7424fba6efedb => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:06.599991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:06.632657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:06.699855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81245-a3ff-4800-aeff-00029e708a14 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:06.733960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:06.734558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:06.734839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:06.735140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:06.799663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:06.801105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:06.829511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:06.895766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 571/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:02:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:02:06.902238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:07.003155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d17b-7291-423c-881c-d65b3b412806 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:07.027704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:07.036672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:07.037301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:07.037582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:07.037858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] PATH_INFO: `/v3/projects/24f41c614d8b4866bbb27a000664db43` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:07.038973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] RBAC: Authorizing `identity:get_project(project_id=24f41c614d8b4866bbb27a000664db43)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:07.040430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e93e8-63a2-47e1-8954-8fd90e6f3119 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:07.042054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 589/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:06 2022] GET /identity/v3/projects/24f41c614d8b4866bbb27a000664db43 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:02:07.048210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:07.144880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03362-2c50-40b1-a8d1-8a73cbc8fb04 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:07.173431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:07.178517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:07.179152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:07.179433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:07.180196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:07.180920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=24f41c614d8b4866bbb27a000664db43, user.id=e7646b3f8b30463e98c7424fba6efedb) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:07.181226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:07.182649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f8f2-15f9-4b99-a3a6-45a86d222da2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:07.188212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 572/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:02:07 2022] GET /identity/v3/role_assignments?user.id=e7646b3f8b30463e98c7424fba6efedb&scope.project.id=24f41c614d8b4866bbb27a000664db43&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:09.329717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb96e7-773a-4e35-9395-6868abd785bf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:09.330262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb96e7-773a-4e35-9395-6868abd785bf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:09.330262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb96e7-773a-4e35-9395-6868abd785bf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:09.331618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 590/1162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:09.337257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:09.337675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:09.337775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:09.355915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:09.357078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:09.421440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 573/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:09.693899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb96e7-773a-4e35-9395-6868abd785bf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:09.791881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb96e7-773a-4e35-9395-6868abd785bf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:09.823692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:09.824278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:09.824553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:09.824820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:09.881407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:09.889352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:09.890787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:09.986618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 591/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:02:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:02:09.993482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:10.087690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f3d79-c0bc-4cc1-bc67-318ebe9c6b8c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:10.112644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:10.121811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:10.122439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:10.122713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:10.122983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:10.129537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:10.130971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cd8acced-b5f6-476e-844a-fe03c9da7979 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:10.141887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:10.143110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:02:10.143993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 574/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:02:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:10.149382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:10.241501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:10.248960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218fed-47b0-47b5-ba78-f1ff62610ea7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:10.281269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:10.281867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:10.282143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:10.282409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:10.283056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:10.283350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:10.284698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a309-067b-4cbc-92f9-83475aa6f155 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:10.292123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 592/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 12 14:02:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:12.372288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2571-05d7-4bf5-a85e-d0bc51411670 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:12.372786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2571-05d7-4bf5-a85e-d0bc51411670 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:12.372786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2571-05d7-4bf5-a85e-d0bc51411670 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:12.374073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 575/1167] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:12.379222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7b2c-9cfc-4f46-aac5-b2c8b7ddba7f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:12.379587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7b2c-9cfc-4f46-aac5-b2c8b7ddba7f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:12.379777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7b2c-9cfc-4f46-aac5-b2c8b7ddba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:12.397996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a76e7b2c-9cfc-4f46-aac5-b2c8b7ddba7f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:12.399187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a76e7b2c-9cfc-4f46-aac5-b2c8b7ddba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:12.462595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 593/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:12.725476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2571-05d7-4bf5-a85e-d0bc51411670 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:12.823743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2571-05d7-4bf5-a85e-d0bc51411670 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:12.855807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:12.856389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:12.856665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:12.856932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:12.857581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:12.858938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e128a5-3eb3-4622-b157-37b65dda6b38 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:12.875608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 576/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Mon Sep 12 14:02:12 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:02:15.017847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ff7e-3cf4-4e04-a65b-8ad2b0d07236 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:15.018398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ff7e-3cf4-4e04-a65b-8ad2b0d07236 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:15.018398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ff7e-3cf4-4e04-a65b-8ad2b0d07236 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:15.019803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 594/1170] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:15.024906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:15.025308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:15.025449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:15.043524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:15.044686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:15.085323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:15.110766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 577/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:15.384526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ff7e-3cf4-4e04-a65b-8ad2b0d07236 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:15.469984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:15.489345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ff7e-3cf4-4e04-a65b-8ad2b0d07236 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:15.522557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:15.523714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:15.523999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:15.524273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] PATH_INFO: `/v3/domains/4feb5e16088243c08b7d620480bb4978` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:15.534209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4feb5e16088243c08b7d620480bb4978)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:15.535679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdf400-6879-4055-9dbb-48ee54af6e3f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:15.537247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 595/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Sep 12 14:02:15 2022] GET /identity/v3/domains/4feb5e16088243c08b7d620480bb4978 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:15.543704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:15.637092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc174b-1e5d-4d14-aefa-6173b1e96136 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:15.669811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:15.670413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:15.670695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:15.670966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:15.671647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:15.673072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff11a7-09ac-40e2-8712-119ef758f19c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:15.698301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 578/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:02:15 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:02:17.874538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155811-49c7-40ef-9350-e8103edecdb4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:17.875197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155811-49c7-40ef-9350-e8103edecdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:17.875197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155811-49c7-40ef-9350-e8103edecdb4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:17.876460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 596/1174] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:17.881719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:17.882105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:17.882262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:17.900331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:17.901496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:17.923647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:17.966762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 579/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:18.229570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be155811-49c7-40ef-9350-e8103edecdb4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:18.327587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be155811-49c7-40ef-9350-e8103edecdb4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:18.358638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:18.359276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:18.359556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:18.359828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] PATH_INFO: `/v3/domains/4feb5e16088243c08b7d620480bb4978` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:18.360915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4feb5e16088243c08b7d620480bb4978)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:18.362340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080fde-7589-4d92-974e-b86e50dd5b55 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:18.364153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 597/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Sep 12 14:02:18 2022] GET /identity/v3/domains/4feb5e16088243c08b7d620480bb4978 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:18.370183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:18.464787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7b0b-00ea-419c-9b68-df89b24728fb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:18.497258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:18.497794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:18.498071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:18.498340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:18.498984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:18.500441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10577b79-8955-4bd6-b241-f497f980eb8b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:18.521089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 580/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:02:18 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:02:20.672535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac16d5-b948-4838-ac7d-f01fa05d321d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:20.673087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac16d5-b948-4838-ac7d-f01fa05d321d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:20.673087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac16d5-b948-4838-ac7d-f01fa05d321d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:20.674416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 598/1178] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:20.680141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:20.680554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:20.680695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:20.698911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:20.700117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:20.709029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:20.765787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 581/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:21.033467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac16d5-b948-4838-ac7d-f01fa05d321d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:21.051974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:21.133777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac16d5-b948-4838-ac7d-f01fa05d321d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:21.165354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:21.165968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:21.166245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:21.166512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:21.176451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:02:21.181744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:21.182893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:02:21.184009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 599/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:21.188713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:21.282794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a080f-3c36-4d15-bc21-951443866b59 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:21.315391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:21.315929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:21.316209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:21.316481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:21.317138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:21.317437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:21.318794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:21.326440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 582/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:21.332092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:21.405710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:21.428140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa74b-8e18-4273-9cf2-9e92f8430a24 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:21.459223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:21.459831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:21.460106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:21.460896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] PATH_INFO: `/v3/users/00bf8b72788b4baaa4d0eafbdadd196f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:21.473190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] RBAC: Authorizing `identity:get_user(user_id=00bf8b72788b4baaa4d0eafbdadd196f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:21.474606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:21.476804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 600/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/users/00bf8b72788b4baaa4d0eafbdadd196f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:21.482624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:21.491979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:21.584464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d50fe-6570-4815-8589-2af9bc52b3e5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:21.617451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:21.618041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:21.618314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:21.618580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:21.681646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:21.683113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:21.690293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:21.777015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 583/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:02:21.782892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:21.876864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231fa6f-518d-45c8-97ed-0b1f62399cef None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:21.909561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:21.910178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:21.910456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:21.910726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] PATH_INFO: `/v3/projects/0e12cd314d8e492f8f23924e8ce88244` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:21.911856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] RBAC: Authorizing `identity:get_project(project_id=0e12cd314d8e492f8f23924e8ce88244)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:21.913266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad1b8-9099-4460-86b9-00ca221e8511 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:21.914897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 601/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/projects/0e12cd314d8e492f8f23924e8ce88244 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:21.920917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:22.015528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c524f4b-46a0-467d-bdf2-1cf471d351e4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:22.022507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:22.048643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:22.049236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:22.049516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:22.049786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:22.050503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=0e12cd314d8e492f8f23924e8ce88244, user.id=00bf8b72788b4baaa4d0eafbdadd196f) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:22.050808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:22.052274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d640bc-252e-4fde-88fe-c4532cd83efe None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:22.057896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 584/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:02:21 2022] GET /identity/v3/role_assignments?user.id=00bf8b72788b4baaa4d0eafbdadd196f&scope.project.id=0e12cd314d8e492f8f23924e8ce88244&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:24.146907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd0251-79a9-4368-9c65-2a7363a81b4d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:24.147399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd0251-79a9-4368-9c65-2a7363a81b4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:24.147506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd0251-79a9-4368-9c65-2a7363a81b4d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:24.148845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 602/1186] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:24.154017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:24.154411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:24.154559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:24.172945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:24.174116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:24.237499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 585/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:24.506200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd0251-79a9-4368-9c65-2a7363a81b4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:24.509673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:24.603020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd0251-79a9-4368-9c65-2a7363a81b4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:24.636429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:24.637030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:24.637303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:24.637575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:24.647056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:02:24.652279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:24.653397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:02:24.654448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 603/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:24.659272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:24.751905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:24.754710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e2ee6-222a-4c42-aad8-24e423be0a34 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:24.787985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:24.788525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:24.788800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:24.789069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:24.789752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:24.790051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:24.791438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:24.798976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 586/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:24.804797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:24.863885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:24.903248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f453-c2e0-4ae7-b3c6-0fefa6d8b83c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:24.935559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:24.936175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:24.936463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:24.936723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] PATH_INFO: `/v3/users/00bf8b72788b4baaa4d0eafbdadd196f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:24.937819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] RBAC: Authorizing `identity:get_user(user_id=00bf8b72788b4baaa4d0eafbdadd196f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:24.939255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:24.940806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 604/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:02:24 2022] GET /identity/v3/users/00bf8b72788b4baaa4d0eafbdadd196f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:24.947145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:25.042686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9bc1c-2245-4937-8e71-502d78047d06 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:25.074920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:25.075556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:25.075833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:25.076102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] PATH_INFO: `/v3/projects/0e12cd314d8e492f8f23924e8ce88244` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:25.077184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] RBAC: Authorizing `identity:get_project(project_id=0e12cd314d8e492f8f23924e8ce88244)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:25.078603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749c2e-365e-413c-a160-1f6ffe2020cf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:25.080226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 587/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:24 2022] GET /identity/v3/projects/0e12cd314d8e492f8f23924e8ce88244 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:25.086363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:25.181443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d063-a34a-4ea5-b6d2-38dd7ee73edb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:25.207802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:25.214281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:25.214925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:25.215230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:25.215502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] PATH_INFO: `/v3/projects/0e12cd314d8e492f8f23924e8ce88244/users/00bf8b72788b4baaa4d0eafbdadd196f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:25.217350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] RBAC: Authorizing `identity:create_grant(project_id=0e12cd314d8e492f8f23924e8ce88244, user_id=00bf8b72788b4baaa4d0eafbdadd196f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:25.218757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2051c-d54c-435d-a1ac-67a6773371bf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:25.231617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 605/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:02:25 2022] PUT /identity/v3/projects/0e12cd314d8e492f8f23924e8ce88244/users/00bf8b72788b4baaa4d0eafbdadd196f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:02:27.346885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d49a7-248d-4ba9-b798-e29f6a4988b6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:27.347464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d49a7-248d-4ba9-b798-e29f6a4988b6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:27.347464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d49a7-248d-4ba9-b798-e29f6a4988b6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:27.348790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 588/1193] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:02:27.354013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:27.354444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:27.354539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:27.373009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:02:27.374113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:02:27.437456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 606/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:02:27.703207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d49a7-248d-4ba9-b798-e29f6a4988b6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:27.732885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:27.801237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d49a7-248d-4ba9-b798-e29f6a4988b6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:27.833462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:27.834069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:27.834345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:27.834614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:27.844174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:02:27.848925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:02:27.850020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:02:27.851425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 589/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:02:27.856360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:27.949711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333678d8-42fd-43b4-ab19-5d9ebcc674f1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:27.968642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:27.983437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:27.984039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:27.984318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:27.984591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:27.985252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:27.985555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:27.986904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:27.995496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 607/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:28.001638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:28.088696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:28.098369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab889e8-b1e5-46e7-95d7-93bdf602fa0c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:28.133082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:28.133708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:28.133982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:28.134245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] PATH_INFO: `/v3/users/00bf8b72788b4baaa4d0eafbdadd196f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:28.135377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] RBAC: Authorizing `identity:get_user(user_id=00bf8b72788b4baaa4d0eafbdadd196f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:28.136799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:28.138359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 590/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 12 14:02:28 2022] GET /identity/v3/users/00bf8b72788b4baaa4d0eafbdadd196f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:28.144069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:28.239698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd5f9-f4e5-4974-8a47-a1f4ce02691b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:28.270951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:28.271565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:28.271847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:28.272121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:28.318375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:28.336589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:28.338020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:28.431470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 608/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:02:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:02:28.437289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:28.533404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db2c92-9f62-427c-ab37-e4dd0aaf611f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:28.565523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:28.566163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:28.566441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:28.566713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] PATH_INFO: `/v3/projects/0e12cd314d8e492f8f23924e8ce88244` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:28.567831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] RBAC: Authorizing `identity:get_project(project_id=0e12cd314d8e492f8f23924e8ce88244)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:28.569779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64fef-dc89-4a77-8eb1-50bed9e9d804 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:28.571413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 591/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 12 14:02:28 2022] GET /identity/v3/projects/0e12cd314d8e492f8f23924e8ce88244 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:28.577324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:02:28.654775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:28.679487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0fbe5-47bd-478c-b04d-f015e4653c21 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:02:28.712847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:02:28.713447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:02:28.713723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:02:28.713989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:02:28.714709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=0e12cd314d8e492f8f23924e8ce88244, user.id=00bf8b72788b4baaa4d0eafbdadd196f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:02:28.715008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:02:28.716446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae6faa-2cc1-4737-8a46-31702be33f25 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:02:28.721985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 609/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:02:28 2022] GET /identity/v3/role_assignments?user.id=00bf8b72788b4baaa4d0eafbdadd196f&scope.project.id=0e12cd314d8e492f8f23924e8ce88244&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:02:38.561498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:02:38.719430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=27 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:23.932930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70614-1581-4689-8a47-8a2a9173683c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:23.933561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70614-1581-4689-8a47-8a2a9173683c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:23.933561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70614-1581-4689-8a47-8a2a9173683c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:23.939015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 592/1201] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:23.941018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:23.942002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:23.942104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:23.968210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:23.969487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:24.075092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 610/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:24.365630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70614-1581-4689-8a47-8a2a9173683c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:24.489586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70614-1581-4689-8a47-8a2a9173683c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:24.544536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:24.545191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:24.545470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:24.545744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:24.558501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:24.560183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:24.578858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:24.580711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:24.581735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:24.581735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:24.581735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:24.585542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 593/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:24.586921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:24.708629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19f6b-49e2-4279-99ac-7fecaae68d4c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:24.742770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:24.749864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:24.750486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:24.750766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:24.751126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:24.751804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:24.752107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:24.756504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559757-016d-456a-a830-93b7cd9c803b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:24.775795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 611/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:24.777469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:24.852552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:24.920364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d26d5-5d25-46f2-8186-1b54c4ec76bd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:24.956289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:24.957060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:24.957361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:24.957697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:24.958453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:24.960050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132c2d1-165e-47fa-85ca-bcabda2d2ec5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:24.993967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 594/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 12 14:03:24 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:03:27.474027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56335d-947d-4cee-a59c-49ca980a916a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:27.474562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56335d-947d-4cee-a59c-49ca980a916a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:27.474686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56335d-947d-4cee-a59c-49ca980a916a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:27.476240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 612/1206] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:27.481823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:27.482298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:27.482471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:27.506311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:27.507641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:27.596323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 595/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:27.917026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56335d-947d-4cee-a59c-49ca980a916a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:28.031178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56335d-947d-4cee-a59c-49ca980a916a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:28.068391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:28.069091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:28.069375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:28.069672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:28.082805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:28.088722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:28.089994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:28.090927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:28.094947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 613/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:28.096627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:28.143991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:28.210058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e900dd6-4431-4282-92d0-625fb8fc65d7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:28.249944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:28.250567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:28.250991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:28.251376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:28.252138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:28.252553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:28.254281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:28.264576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 596/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:28.271982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:28.324938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:28.391601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ea270-448d-4d85-82a3-d89e3740b9ba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:28.437451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:28.438028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:28.438336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:28.438580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:28.453161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:28.454640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:28.469658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:28.470923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:28.472541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:28.472541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:28.472541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:28.472541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 614/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:28.477036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:28.598491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:28.604189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdff03-f618-45ec-9941-9b5990ad53b0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:28.647490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:28.648475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:28.648811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:28.649174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:28.649996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:28.650301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:28.651884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:28.671080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 597/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:28.673203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:28.799414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe4f7-5961-4c6e-8a02-9d01ad3a112e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:28.799414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:28.841667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:28.842432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:28.842764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:28.843157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:28.853707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:28.855355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:28.869724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:28.870921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:28.872344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:28.875181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 615/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:28.881603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:29.005064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62b40-d371-436a-83c8-f9c916fafab9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:29.046491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:29.047386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:29.047669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:29.047937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:29.048674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:29.048977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:29.050463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:29.069662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 598/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:29.075319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:29.207430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34b9a-9545-4ffa-a067-6c4deaa60f67 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:29.244628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:29.245298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:29.245594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:29.245983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:29.278252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:29.330526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:29.331964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:29.468303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 616/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:03:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:03:29.469551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:29.491615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:29.593771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7682-9207-426d-bc14-9d5b3e7109aa None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:29.634455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:29.635231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:29.635532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:29.635796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:29.648913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:29.650400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:29.666948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:29.668211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:29.669309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:29.669309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:29.669309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:29.669309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 599/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:29.674369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:29.742743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:29.789045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebfc-0d02-4b96-991d-32bcc7c96daa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:29.830726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:29.831404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:29.831678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:29.832576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:29.833277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:29.833648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:29.835204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:29.850140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 617/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:29.856374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:29.940849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:29.974161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9a07-80db-41a5-8cd7-6dc0594b670d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:30.010048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:30.010744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:30.011038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:30.011468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:30.022439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:30.024029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:30.036754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:30.037887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:30.038844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 600/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:30.044015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:30.159836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad746d0-5b0e-420b-8dde-3e4e372f371f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:30.186551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:30.199741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:30.200789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:30.201132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:30.201406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:30.202154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:30.202455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:30.203895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84744-4a96-4541-82e5-32e5363216d7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:30.218715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 618/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:03:30.225007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:30.336285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff872-fa6b-4a19-96ea-412830887476 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:30.366463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:30.373682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:30.374417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:30.374804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:30.375242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:30.376282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=faa6ff05a95b47628fb5208f4b021948) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:30.376680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:30.378577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7701c5-d11c-4e0e-a83b-4c8bff2f8a1d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:30.386744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 601/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:03:30 2022] GET /identity/v3/role_assignments?user.id=faa6ff05a95b47628fb5208f4b021948&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:32.629428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183573-77b8-4cd5-b1a7-9d7916b35632 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:32.630030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183573-77b8-4cd5-b1a7-9d7916b35632 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:32.630030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183573-77b8-4cd5-b1a7-9d7916b35632 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:32.631387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 619/1220] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:32.636501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:32.636908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:32.637058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:32.655627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:32.656807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:32.729070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 602/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:33.025843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183573-77b8-4cd5-b1a7-9d7916b35632 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.139597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183573-77b8-4cd5-b1a7-9d7916b35632 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:33.176991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:33.177768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:33.178121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:33.178487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:33.190472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:33.196407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:33.197645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:33.198733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 620/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:33.204041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.315329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ba4bf-158d-4428-95ad-c36fefc26244 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:33.341985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:33.353865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:33.354605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:33.354965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:33.355358 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:33.356068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:33.356445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:33.357937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:33.367850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 603/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:33.373878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.428953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:33.492759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae132d-d4cb-4b32-982c-9500cea6a178 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:33.529413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:33.530044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:33.530321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:33.530593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:33.541116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:33.542547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:33.557809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:33.559208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:33.560348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:33.560348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:33.560348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:33.560348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 621/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:33.564880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.668424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7638f-326e-4130-8366-7fe33c777e40 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:33.703528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:33.704132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:33.704415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:33.704684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:33.705324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:33.705625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:33.707060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:33.719632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 604/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:33.725755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.840461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:33.849232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755cae-fe51-4f16-8bab-38f224078e76 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:33.890167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:33.890819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:33.891132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:33.891435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:33.900572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:33.902202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:33.915301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:33.916628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:33.917804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 622/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:33.923320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:33.979334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:34.041574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48434a-80af-4deb-850c-d210df8f5dbb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.082554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.083187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.083463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.083720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.084684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:34.085106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.086684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:34.111232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 605/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:34.112605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:34.225425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab041-d6b7-4bf0-8c35-ffcb2ed03685 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.260232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.261051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.261370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.261726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.273042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.274474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:34.293312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:34.294374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:34.296189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:34.296189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:34.296189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:34.296189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 623/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:34.300570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:34.411897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec315ea-1969-4b68-a288-cce00d42acfd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.414222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:34.449141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.449753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.450064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.450373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.451061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:34.451372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.452834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:34.465661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 606/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:03:34.471857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:34.481993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:34.580638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27931254-4a14-4bb4-a17c-fbb78e73e2e9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.619603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.620476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.620870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.621159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.628841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.630768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:34.644348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:34.645395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:34.646707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 624/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:34.651425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:34.755001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47c3c-9bf5-4716-8d2b-bc617871bb7d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.789318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.789924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.790207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.790472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.791214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:34.791495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.792922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80a10e-1aa2-461c-a162-6b208b9ddd49 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:34.805090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 607/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:34.811758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:34.895709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:34.934709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7520ba6-e216-4064-aca7-a80eb3f3d2fd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:34.973009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:34.973966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:34.974401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:34.974722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/faa6ff05a95b47628fb5208f4b021948/roles/deb95b0e674745c48e49041697af4fb7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:34.992128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=faa6ff05a95b47628fb5208f4b021948, role_id=deb95b0e674745c48e49041697af4fb7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:34.993716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b9952-1d9d-474e-b4a4-ce45c2184d13 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:35.015213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 625/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:03:34 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/faa6ff05a95b47628fb5208f4b021948/roles/deb95b0e674745c48e49041697af4fb7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:03:37.196769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0604238-453f-450b-82af-a5a4133b0f18 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:37.197329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0604238-453f-450b-82af-a5a4133b0f18 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:37.197329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0604238-453f-450b-82af-a5a4133b0f18 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:37.198640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 608/1233] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:03:37.207021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:37.207021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:37.207021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:37.223891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:37.225185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:37.298190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 626/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:37.574915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0604238-453f-450b-82af-a5a4133b0f18 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:37.602363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:37.688380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0604238-453f-450b-82af-a5a4133b0f18 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:37.726717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:37.727432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:37.727765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:37.728116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:37.741134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:37.747060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:37.748254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:37.749598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 609/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 12 14:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:37.755169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:37.806311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:37.869598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca127339-3d9b-4647-ae7b-73fad1cce28b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:37.907544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:37.908174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:37.908446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:37.908719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:37.909384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:37.910279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:37.911680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:37.921866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 627/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 12 14:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:37.928462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:38.019906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:38.038373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9f88-acce-4ca3-93a2-73c7228d4a2c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:38.075190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:38.075819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:38.076097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:38.076366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:38.086585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:38.088063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:38.106321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:38.107363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:38.108295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:38.108295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:38.108295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:38.108295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 610/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:38.113863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:38.225963 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6cba-1a21-4ca2-8ace-79f2163ebfa6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:38.234731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:38.260214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:38.260817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:38.262030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:38.262456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:38.263150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:38.263490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:38.264860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:38.277151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 628/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:03:38.283278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:38.393351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b163d-5d8d-4fe8-8153-a5af6374182a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:38.433084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f655454-9d38-40af-847d-964563b095fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:38.433725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655454-9d38-40af-847d-964563b095fc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:38.434015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655454-9d38-40af-847d-964563b095fc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:38.434284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655454-9d38-40af-847d-964563b095fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:38.437779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:38.446492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f655454-9d38-40af-847d-964563b095fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:38.448079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f655454-9d38-40af-847d-964563b095fc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5f655454-9d38-40af-847d-964563b095fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:38.461425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:38.462580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:38.463993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 611/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:38.468759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:38.576590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d84b65-a92e-4746-8bd4-990543b34cdd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:38.612654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:38.613275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:38.613565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:38.613886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:38.614538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:38.614837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:38.616312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:38.633509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 629/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:38.639549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f655454-9d38-40af-847d-964563b095fc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:38.753461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f655454-9d38-40af-847d-964563b095fc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:38.790273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:38.790883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:38.791188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:38.791459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:38.863332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:38.870563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:38.872151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:38.984723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 612/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:03:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 14:03:38.991810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:39.019959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:39.095391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a793d-a554-42ab-a880-6b9c0605ac17 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:39.146978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:39.147569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:39.147951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:39.148309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:39.160850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:39.162303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:39.177886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:39.179343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:39.180523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:39.180523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:39.180523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:39.180523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 630/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:39.185134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:39.287931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:39.294847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc251-e1af-46a8-b2fe-7df367e924a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:39.333459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:39.334154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:39.334485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:39.334777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:39.335503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:39.335834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:39.337400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:39.349752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 613/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:39.355571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:39.442200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:39.466029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08151e8-70da-4c7c-a539-d109c0f6550f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:39.508610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:39.509541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:39.509897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:39.510215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:39.517614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:39.519778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:39.531757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:39.532727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:39.534122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 631/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:39.539400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:39.654006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e096-8871-4ad7-aaf7-29b86945e467 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:39.689761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:39.690378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:39.691198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:39.691458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:39.692145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:39.692505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:39.693998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7234a-f1fe-4df8-8c9f-721954d57cb0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:39.712540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 614/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:39.713797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:39.829759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739443ec-0807-4c37-a58c-23f2ef81bd86 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:39.870864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:39.871645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:39.872009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:39.872320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:39.873099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] RBAC: Adding query filter params (role.id=deb95b0e674745c48e49041697af4fb7, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=faa6ff05a95b47628fb5208f4b021948) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:39.873410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:39.874954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07f46a-f7cd-469d-9826-3d56075726fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:39.882271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 632/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:03:39 2022] GET /identity/v3/role_assignments?user.id=faa6ff05a95b47628fb5208f4b021948&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=deb95b0e674745c48e49041697af4fb7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:42.225819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fd0f1-4dde-45e8-9a81-3aa5c0543506 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:42.226381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fd0f1-4dde-45e8-9a81-3aa5c0543506 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:42.226381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fd0f1-4dde-45e8-9a81-3aa5c0543506 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:42.227791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 615/1247] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:42.232937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:42.233348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:42.233483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:42.241463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:42.254910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:42.256387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:42.329232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 633/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 14:03:42.600051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fd0f1-4dde-45e8-9a81-3aa5c0543506 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:42.618454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:42.713458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fd0f1-4dde-45e8-9a81-3aa5c0543506 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:42.755508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:42.756251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:42.756538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:42.756813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:42.769711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:42.774582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:42.775774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:42.777016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 616/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:42.781787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:42.907950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1bbb4-df5b-4449-941a-79b585703860 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:42.938872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:42.944952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:42.945563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:42.945840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:42.946108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:42.946766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:42.947099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:42.948480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:42.957521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 634/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:42.963777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:43.046952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:43.072450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e106ff-7d4d-4e0f-adc1-e4792007a030 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:43.111078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:43.112011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:43.112404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:43.112774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:43.124459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:43.126109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:43.142206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:43.143305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:43.144749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:43.144749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:43.144749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:43.148743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 617/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:43.150039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:43.262025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f6861-f10a-444a-b8bd-8eef6bcfd0c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:43.297731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:43.298338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:43.298617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:43.298893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:43.299563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:43.300385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:43.301779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:43.314978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 635/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:43.321746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:43.434147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a1092-7c57-42aa-ba66-95f6e22aea19 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:43.462805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:43.472913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:43.473702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:43.474009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:43.474366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:43.482913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:43.484426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:43.498109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:43.499324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:43.500354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 618/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:43.506523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:43.566524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:43.613982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6c04-765b-4ede-bf4d-ea5bdc96afba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:43.649933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:43.650547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:43.650828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:43.651127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:43.651874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:43.652237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:43.653690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:43.674192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 636/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:43.680727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:43.786990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db34a2-91c8-481b-94cc-2837de82408b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:43.838243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:43.838958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:43.839236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:43.839705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:43.905452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:43.918847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:43.920431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.017703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 619/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:03:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:03:44.023871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:44.129300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05564-41af-4b92-82cb-7e6e8a2c885d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:44.143804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:44.167580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:44.168217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:44.168497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:44.168767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:44.179461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:44.180907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:44.194906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:44.196057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:44.197354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:44.197354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:44.197354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:44.197354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 637/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:44.201756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:44.286320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:44.298151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849516ee-a837-4e1b-ba3e-8d0b45791134 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:44.332688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:44.333289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:44.333570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:44.333849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:44.334482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:44.334811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:44.336220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.347014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 620/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:44.352598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:44.450423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a1c7e-35c5-40a4-a273-8f356e5c055f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:44.482133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:44.482737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:44.483014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:44.483313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:44.489833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:44.491281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:44.501996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:44.503555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:44.504677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 638/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 14:03:44.509447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:44.605913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13fbe7-635d-4fc1-939e-e442c4ec80a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:44.638842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:44.639468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:44.639747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:44.640021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:44.640700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:44.641005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:44.642426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae0372-255c-4b7b-b8ac-c20f37c1153b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.653763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 621/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:44.659591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:44.685846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:44.757537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee059c4-1239-4fcd-b971-2b7bc012b13f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:44.788644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:44.789226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:44.789503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:44.789772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:44.790487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=faa6ff05a95b47628fb5208f4b021948) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:44.790787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:44.792228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428324-f752-43ad-a227-b2958534c7cd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:44.797283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 639/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:03:44 2022] GET /identity/v3/role_assignments?user.id=faa6ff05a95b47628fb5208f4b021948&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:46.933101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6590ce-4262-4aea-9d1e-c51e4d8fed9d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:46.933626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6590ce-4262-4aea-9d1e-c51e4d8fed9d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:46.933626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6590ce-4262-4aea-9d1e-c51e4d8fed9d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:46.934959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 622/1261] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:46.940060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:46.940466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:46.940598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:46.958710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:46.959884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:47.023048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 640/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:47.287283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6590ce-4262-4aea-9d1e-c51e4d8fed9d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:47.298018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:47.385841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6590ce-4262-4aea-9d1e-c51e4d8fed9d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:47.418197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:47.418809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:47.419115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:47.419388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:47.429041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:47.433805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:47.434944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:47.436196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 623/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:47.440694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:47.459166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:47.536709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b458bd-e938-4ad1-97b4-03056cd8a02e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:47.569887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:47.570415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:47.570685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:47.570949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:47.571627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:47.571925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:47.573260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:47.580837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 641/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:47.586475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:47.651343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:47.683538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a77a-2157-492a-ad3b-b97e3253860c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:47.716030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:47.716646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:47.716926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:47.717201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:47.726687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:47.728154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:47.742947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:47.744051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:47.745195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:47.745195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:47.745195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:47.745195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 624/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:47.749636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:47.833110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:47.855735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f05e0-7d5c-4bcf-89d4-8e8b3ca268eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:47.890707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:47.891336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:47.891616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:47.891887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:47.892522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:47.892823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:47.894177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:47.905416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 642/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:47.911616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.006503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce178d-ae02-454d-90ea-37dc573e0c52 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.024792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:48.038878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.039515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.039793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.040058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.047861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.049288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:48.060575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:48.061700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:48.062901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 625/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:48.067303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.167786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb76d-fa2d-4e64-ae48-3e3bc5bdcc19 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.201696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.202288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.202562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.202830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.203640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:48.203942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.205352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.213517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:48.222089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 643/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:48.228454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.324714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e79b4-6a3d-44ab-a9ce-d4d2447bd4ba None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.357475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.358083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.358361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.358634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.370098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.371560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:48.386084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:48.387240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:48.388160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:48.388160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:48.388160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:48.388160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 626/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:48.392921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.485816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198b74-bbf4-4589-b812-e59f31fff85c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.518497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.519108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.519387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.519679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.520306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:48.520603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.521952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.532519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 644/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:48.537946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.569501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:48.636338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5847a-0f6b-4e48-af4c-0e5d8ef33033 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.668692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.669311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.669591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.669865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.676828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.678271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:48.689231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:48.690275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:48.691579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 627/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:48.695996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.751790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:48.792495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e34f-de82-4d0d-a6f5-bc2e443bacc8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.831802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.832550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.832834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.833174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.833866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:48.834173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.835662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250fcc-cf64-4591-b419-25d2cd598d6b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:48.847675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 645/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:48.854117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:48.942689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:48.951527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46734a-7a90-406e-94dd-b8543bb54fff None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:48.983934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:48.984578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:48.984857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:48.985128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] PATH_INFO: `/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/faa6ff05a95b47628fb5208f4b021948/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:48.987277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] RBAC: Authorizing `identity:create_grant(project_id=11d3d20415e14e63bf4d66466eedf6cd, user_id=faa6ff05a95b47628fb5208f4b021948, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:48.989338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb98388-4a2c-46d0-9229-3c0746efd182 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:49.001170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 628/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 12 14:03:48 2022] PUT /identity/v3/projects/11d3d20415e14e63bf4d66466eedf6cd/users/faa6ff05a95b47628fb5208f4b021948/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:03:51.136134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ec8b-4cb7-4617-a860-7374e18fd765 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:51.136602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ec8b-4cb7-4617-a860-7374e18fd765 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:51.136716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ec8b-4cb7-4617-a860-7374e18fd765 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:51.138029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 646/1274] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:51.143312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:51.143714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:51.143862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:51.162130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:51.163325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:51.227182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 629/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:51.493200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636ec8b-4cb7-4617-a860-7374e18fd765 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:51.590912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636ec8b-4cb7-4617-a860-7374e18fd765 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:51.607121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:51.624882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:51.625497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:51.625775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:51.626047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:51.636303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 14:03:51.641086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:51.642204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:51.643087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 647/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 12 14:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:51.647954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:51.725810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:51.744753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c788a-82ee-454f-95a5-da76c451efab None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:51.777361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:51.777949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:51.778225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:51.778495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:51.779179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:51.779482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:51.780845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:51.789115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 630/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 12 14:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:51.794817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:51.904310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc9b4e-3402-4466-972f-fd8352967c51 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:51.937578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:51.938195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:51.938474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:51.938746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:51.948367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:51.949798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:51.964286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:51.969993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:51.971187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:51.971187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:51.971187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:51.971187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 648/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:51.971493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.067203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567da55-3fba-4622-96c2-6d2bbafae69d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:52.099560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:52.100143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:52.100416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:52.100684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:52.101308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:52.101603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:52.102954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:52.114479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 631/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:52.120157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.149944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:52.216086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78cd7-7c7d-4b3b-9c43-c56ac5e2d35e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:52.248383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:52.248994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:52.249273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:52.249545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:52.256762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:52.258200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 14:03:52.268978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:52.270596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:52.271800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 649/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:52.276314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.280013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:52.372177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3028-7eab-43e4-809a-1cc289daaa28 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:52.404805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:52.405395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:52.405669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:52.405935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:52.406648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:52.406947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:52.408383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:52.424430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 632/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 12 14:03:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:52.430051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.516248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:52.526516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7598-624b-4eb9-b4a0-6444838d07da None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:52.557812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:52.558396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:52.558676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:52.558944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:52.622809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:52.624207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:52.708375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:52.718353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 650/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 12 14:03:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 14:03:52.723981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.783142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:52.821785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e5f2-850c-4851-ad80-4b5b3ad085cf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:52.853842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:52.854464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:52.854745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:52.855018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:52.865515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:52.866955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 14:03:52.881552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:52.882834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 14:03:52.884104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 14:03:52.884104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 14:03:52.884104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:52.884104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 633/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:52.888142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:52.982225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ed39-874b-40c4-bbcc-3f70e68a809c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:53.015021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:53.015640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:53.015915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:53.016182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:53.016807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:53.017104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:53.018445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:53.029086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 651/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 12 14:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:53.035449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:53.133860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511574-eaf7-4c70-83d6-af9685dfae67 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:53.146858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:53.166919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:53.167575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:53.167859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:53.168135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:53.174442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:53.176511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 14:03:53.188288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:53.189350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 12 14:03:53.190260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 634/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 12 14:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:53.195241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:53.244021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:53.291728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a11d6-d8af-40a3-9c35-3fb2a9018eb6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:53.323554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:53.324147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:53.324425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:53.324712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:53.325396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:53.325698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:53.327138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386dc9-741a-4ad7-9f97-7f4d00d61019 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:53.338502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 652/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 12 14:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:53.344549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:53.442093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5cef-a3a1-4975-a388-dce88ab66a42 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:53.474231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:53.474812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:53.475115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:53.475386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:53.476097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] RBAC: Adding query filter params (role.id=c0a540da48234e2db9dc1b474267f52f, scope.project.id=11d3d20415e14e63bf4d66466eedf6cd, user.id=faa6ff05a95b47628fb5208f4b021948) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:53.476406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:53.477811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2935-94e1-41e6-a5b8-cf67dcfd45a8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:53.483338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 635/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 12 14:03:53 2022] GET /identity/v3/role_assignments?user.id=faa6ff05a95b47628fb5208f4b021948&scope.project.id=11d3d20415e14e63bf4d66466eedf6cd&role.id=c0a540da48234e2db9dc1b474267f52f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:55.614931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10e40-e0bb-4f01-aba9-06efd3a209ad None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:55.615489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10e40-e0bb-4f01-aba9-06efd3a209ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:55.615489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b10e40-e0bb-4f01-aba9-06efd3a209ad None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:55.616842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 653/1288] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:55.622037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:55.622428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:55.622579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:55.640218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:55.641376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:55.669835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:55.706145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 636/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:55.984235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b10e40-e0bb-4f01-aba9-06efd3a209ad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:56.080525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b10e40-e0bb-4f01-aba9-06efd3a209ad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:56.091140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:56.114972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:56.115625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:56.115906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:56.116180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:56.116761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:56.118144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:03:56.126823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:03:56.128061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:03:56.129647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 654/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:03:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:03:56.134299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:56.229160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2582-c951-4c3b-a621-34fffcefd3bd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:56.261610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:56.262147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:56.262423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:56.262690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:56.263350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:56.263639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:56.264991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea24c-926e-4097-83bb-83c97a7f0160 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:56.270204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 637/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 12 14:03:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:56.275879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:56.372101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5226eb-3e5f-4b28-bb21-c121a342c18c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:56.404505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:56.405099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:56.405392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:56.405652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:56.406274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:03:56.406575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:56.407953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b2036-f5f7-4319-955b-faedb1c735fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:56.412201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 655/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 12 14:03:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:03:58.499151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68d7-50d5-456f-97ee-5daecd72e1e7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:58.499658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68d7-50d5-456f-97ee-5daecd72e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:58.499751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68d7-50d5-456f-97ee-5daecd72e1e7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:58.501017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 638/1293] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:03:58.506592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497f84-567a-4ade-88b4-9dc7c5156b26 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:58.506989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497f84-567a-4ade-88b4-9dc7c5156b26 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:58.507186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497f84-567a-4ade-88b4-9dc7c5156b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:58.525521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-06497f84-567a-4ade-88b4-9dc7c5156b26 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:03:58.526703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-06497f84-567a-4ade-88b4-9dc7c5156b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:03:58.554731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:58.592165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 656/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:03:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:03:58.857226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b68d7-50d5-456f-97ee-5daecd72e1e7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:03:58.892824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:03:58.960579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b68d7-50d5-456f-97ee-5daecd72e1e7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:03:58.992866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:03:58.993459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:03:58.993733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:03:58.994001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:03:58.994646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:03:58.996043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2fb1-2b25-417d-9226-a9dcf4b08151 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:03:59.010179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 639/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 12 14:03:58 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:04:01.190226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce310b5e-6972-42cd-bcee-5c90edc848ad None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:01.190765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce310b5e-6972-42cd-bcee-5c90edc848ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:01.190765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce310b5e-6972-42cd-bcee-5c90edc848ad None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:01.192146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 657/1296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:04:01.197242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:01.197647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:01.197785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:01.215877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:04:01.217041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:04:01.287016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 640/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:04:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:04:01.555816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce310b5e-6972-42cd-bcee-5c90edc848ad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:01.652438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce310b5e-6972-42cd-bcee-5c90edc848ad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:01.683676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:01.684282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:01.684556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:01.684825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:01.685398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:01.686733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:04:01.695758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:04:01.696936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:01.697984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 658/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:04:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:04:01.702598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:01.720749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:01.799342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4727cf-9dc5-49a4-8c05-48a3bee93d44 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:01.839935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:01.840497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:01.840837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:01.841117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:01.841899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:04:01.842384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:01.843703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:01.852770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 641/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 12 14:04:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:04:01.855939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:01.891501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:01.958092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a482-81b9-408c-923a-f90d965c367a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:01.989928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:01.990520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:01.990795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:01.991088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:01.991781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] RBAC: Adding query filter params (interface=public, service_id=aeb449fcbf94467d98157b5a6cbb68b7, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:04:01.992086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:01.993435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201c5e-3d0c-4cba-abbb-82f8727ae45a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:01.998197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 659/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 12 14:04:01 2022] GET /identity/v3/endpoints?service_id=aeb449fcbf94467d98157b5a6cbb68b7&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:04:02.004466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:02.082096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:02.102406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d7c6-fab8-49b5-9cdd-5a2d3315e357 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:02.151219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:02.151834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:02.152112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:02.152383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:02.152995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:02.154363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff66a-41ea-43a2-8cef-610d506b4e83 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:02.161530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 642/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 12 14:04:02 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:04:04.258401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b26ad-6c5b-4d00-b4fb-d6877e4bcb96 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:04.258960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b26ad-6c5b-4d00-b4fb-d6877e4bcb96 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:04.258960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b26ad-6c5b-4d00-b4fb-d6877e4bcb96 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:04.260320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 660/1302] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:04:04.265578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:04.265965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:04.266175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:04.285293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:04:04.286474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:04:04.350615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 643/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:04:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 14:04:04.622531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b26ad-6c5b-4d00-b4fb-d6877e4bcb96 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:04.715276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:04.722132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b26ad-6c5b-4d00-b4fb-d6877e4bcb96 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:04.755338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:04.755959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:04.756240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:04.756512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:04.757091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:04.758446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 14:04:04.767049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 14:04:04.768310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Sep 12 14:04:04.769379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 661/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 12 14:04:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 14:04:04.774102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:04.848100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:04.870644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6a5aa-bfc4-4cab-b044-b93cf25ef41b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:04.903374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:04.903915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:04.904194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:04.904464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:04.905084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:04:04.905386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:04.906752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c4b54-6e93-4149-8c69-6c183a2e3583 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:04.912417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 644/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 12 14:04:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:04:04.918274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:04:05.013881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce967-38a6-40e1-9736-376199a38329 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:04:05.046496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:04:05.047114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:04:05.047391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:04:05.047657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:04:05.048319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:04:05.049659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c946-c223-44d4-a411-c7daa213a09e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:04:05.068007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 662/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:04:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:04:14.909710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=30 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:04:15.064333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:08.816005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677116-15a4-42be-9672-cdf0073c561e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:08.816911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677116-15a4-42be-9672-cdf0073c561e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:08.817332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677116-15a4-42be-9672-cdf0073c561e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:08.819465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 645/1307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:08.824719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be788a8-9f50-4b4e-9b56-1fd89b2e2485 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:08.825508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be788a8-9f50-4b4e-9b56-1fd89b2e2485 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:08.825926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be788a8-9f50-4b4e-9b56-1fd89b2e2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:08.917777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0be788a8-9f50-4b4e-9b56-1fd89b2e2485 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:08.918966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0be788a8-9f50-4b4e-9b56-1fd89b2e2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:09.030232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 663/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:09.324488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:09.324770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:09.325251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:09.326833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 646/1309] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 12 14:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:09.333331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203d23-7c63-4aff-9f3b-824a1e33321d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:09.333632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203d23-7c63-4aff-9f3b-824a1e33321d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:09.333883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203d23-7c63-4aff-9f3b-824a1e33321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:09.424669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a2203d23-7c63-4aff-9f3b-824a1e33321d None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:09.425872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a2203d23-7c63-4aff-9f3b-824a1e33321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:09.448794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:09.507387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 664/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 12 14:05:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:09.516220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:09.517951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:09.627594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276d2c-37cd-40ee-baa0-34cb982c62ac None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:09.702113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:09.702637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:09.703457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:09.703730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:09.705556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:09.762854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:09.821536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:09.822985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4ee0b-ad85-4601-9277-0cedd90f7afd service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:09.842032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 647/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:12.273471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:12.274029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:12.274029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:12.275447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 665/1312] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:12.280553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762a35-db75-4a0e-9475-14194e10894b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:12.281492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762a35-db75-4a0e-9475-14194e10894b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:12.281595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0762a35-db75-4a0e-9475-14194e10894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:12.350362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d0762a35-db75-4a0e-9475-14194e10894b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:12.351504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d0762a35-db75-4a0e-9475-14194e10894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:12.448925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 648/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:12.730087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:12.731657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:12.833867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687a6f-61a4-4ed8-b8e5-dcff93ca2c00 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:12.908820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:12.911361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:12.912210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:12.912528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:12.912986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:12.914826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:13.024093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:13.025451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3bea-f3df-4fcd-903d-bc30a00f66b5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:13.044121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 666/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:15.497603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:15.498137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:15.498137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:15.500039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 649/1315] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:15.505267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155a1d-6c1c-434f-8bc4-69fc11fca7e2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:15.505676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155a1d-6c1c-434f-8bc4-69fc11fca7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:15.505813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155a1d-6c1c-434f-8bc4-69fc11fca7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:15.572075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6e155a1d-6c1c-434f-8bc4-69fc11fca7e2 None None] MFA Rules not processed for user `e934d55fcbc2436b925f31333bafe076`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:15.573270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6e155a1d-6c1c-434f-8bc4-69fc11fca7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:15.623136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:15.666286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 667/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:15.948768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:15.950397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:15.960067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:16.052442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f0468-250d-41e0-b388-89f328fc76b0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:16.126222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:16.126835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:16.127138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:16.127606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:16.129236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:16.191477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:16.238326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:16.239826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443d298-4a4c-45e8-b675-1330755f6b28 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:16.259510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 650/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:18.916825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:18.917367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:18.917367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:18.918754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 668/1318] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:18.924396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6916-df2a-49c8-afc6-e59e790135d8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:18.924816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6916-df2a-49c8-afc6-e59e790135d8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:18.924947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6916-df2a-49c8-afc6-e59e790135d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:18.989688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f68e6916-df2a-49c8-afc6-e59e790135d8 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:18.990888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f68e6916-df2a-49c8-afc6-e59e790135d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:19.088347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 651/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:19.380003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:19.381552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:19.483217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2863c5-3167-4ffb-82b0-019494b130f7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:19.559723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:19.560325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:19.560603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:19.560872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:19.563114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:19.569754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:19.669441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:19.670790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042de91-0fbb-4579-868f-103b50097e00 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:19.691927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 669/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:22.463755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:22.464292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:22.464292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:22.465565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 652/1321] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:22.471041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4223aa-6d80-4e4f-b688-a705c2c372cf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:22.471427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4223aa-6d80-4e4f-b688-a705c2c372cf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:22.471605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4223aa-6d80-4e4f-b688-a705c2c372cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:22.544212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8e4223aa-6d80-4e4f-b688-a705c2c372cf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:22.545472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e4223aa-6d80-4e4f-b688-a705c2c372cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:22.606396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:22.649181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 670/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:22.926358 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:22.927909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:22.947201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:23.028950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842e05-3d19-43a9-941e-eb1cf073ff46 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:23.100635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:23.101234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:23.101507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:23.101769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:23.103371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:23.177500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:23.215170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:23.216624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7596d9f-c4dd-438b-9a09-54a998425d54 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:23.236175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 653/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:25.436020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:25.436531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:25.436531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:25.437883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 671/1324] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:25.443078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372416-1136-4862-bb94-4b82faf9e0ee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:25.443484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372416-1136-4862-bb94-4b82faf9e0ee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:25.443669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372416-1136-4862-bb94-4b82faf9e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:25.508604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b5372416-1136-4862-bb94-4b82faf9e0ee None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:25.509817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b5372416-1136-4862-bb94-4b82faf9e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:25.612693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 654/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:25.895076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:25.896615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:25.997455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872ddd3-279a-4131-829c-e8187de56759 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:26.073566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:26.074184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:26.074464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:26.074735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:26.076368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:26.095712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:26.192225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:26.193576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19067-49a3-4700-be99-7f6c96da8eb8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:26.212208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 672/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:28.406045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a64fd9-f2df-4a65-9d0d-d52c26622fb3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:28.406568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a64fd9-f2df-4a65-9d0d-d52c26622fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:28.406568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a64fd9-f2df-4a65-9d0d-d52c26622fb3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:28.407980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 655/1327] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:28.413304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd6c2-1512-430a-a668-c636775acde8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:28.413708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd6c2-1512-430a-a668-c636775acde8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:28.413803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd6c2-1512-430a-a668-c636775acde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:28.478321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-94bdd6c2-1512-430a-a668-c636775acde8 None None] MFA Rules not processed for user `e934d55fcbc2436b925f31333bafe076`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:28.479558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94bdd6c2-1512-430a-a668-c636775acde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:28.545328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:28.576720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 673/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:28.878535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:28.878815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:28.879122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:28.880481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 656/1329] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 12 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:28.886620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f336-49e3-44ab-bb35-8a677d501305 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:28.886971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f336-49e3-44ab-bb35-8a677d501305 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:28.887393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f336-49e3-44ab-bb35-8a677d501305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:28.966893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9968f336-49e3-44ab-bb35-8a677d501305 None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:28.968133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9968f336-49e3-44ab-bb35-8a677d501305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:29.042678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 674/1330] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 12 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:05:29.051711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:29.053253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:29.084740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:29.160622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8390745-a8fc-4311-aa8b-4d6ee61bc910 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:29.234306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:29.235214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:29.235495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:29.235767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:29.237363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:29.314902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:29.346978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:29.348425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba1ee-9007-4483-839d-d96a881ea1cb service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:29.367609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 657/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:32.099409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:32.099938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:32.099938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:32.101295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 675/1332] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:32.106595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7bde0-cb5d-4dd7-986a-9b275ddf0232 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:32.107149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7bde0-cb5d-4dd7-986a-9b275ddf0232 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:32.107149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7bde0-cb5d-4dd7-986a-9b275ddf0232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:32.172397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e0f7bde0-cb5d-4dd7-986a-9b275ddf0232 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:32.173589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0f7bde0-cb5d-4dd7-986a-9b275ddf0232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:32.267590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 658/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:32.554197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:32.555837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:32.624742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:32.658121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9042-58e0-4762-9074-7394e0f30dea None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:32.728382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:32.728983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:32.729260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:32.729529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:32.731135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:32.839080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:32.840451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651496f-ddb3-4cfd-a5d7-4234d01bbdf2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:32.850352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:32.858651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 676/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:35.081145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:35.081810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:35.081810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:35.083022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 659/1335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:35.088164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b24-6fde-4106-bd60-b057203f21a2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:35.088616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b24-6fde-4106-bd60-b057203f21a2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:35.088724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b24-6fde-4106-bd60-b057203f21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:35.154719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d9d23b24-6fde-4106-bd60-b057203f21a2 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:35.155952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9d23b24-6fde-4106-bd60-b057203f21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:35.250020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 677/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:35.535776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:35.537342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:35.577733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:35.639959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116a3cb-38c8-471c-81f9-8702c61b2a64 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:35.711121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:35.711675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:35.711950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:35.712216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:35.713791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:35.794876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:35.821139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:35.822585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c42f-f0ab-4261-bae4-b50deed8abb9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:35.840641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 660/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:38.400439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:38.400974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:38.400974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:38.402261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 678/1338] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:38.407960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9c31-c775-4135-88b7-aa0234d2c28a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:38.408398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9c31-c775-4135-88b7-aa0234d2c28a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:38.408506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9c31-c775-4135-88b7-aa0234d2c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:38.473478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ca6e9c31-c775-4135-88b7-aa0234d2c28a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:38.474677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca6e9c31-c775-4135-88b7-aa0234d2c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:38.567873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 661/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:38.847821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:38.849412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:38.925334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:38.952602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd1e6-aba3-4d91-adfc-07cba28e1567 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:39.024097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:39.024692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:39.024965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:39.025230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:39.026817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:39.131515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:39.132951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16770359-e68a-4c80-b90e-ad275a0669c9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:39.150320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 679/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:43.307577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:43.308085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:43.308085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:43.309365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 662/1341] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:43.315208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fce9a-c89b-437d-9a0a-04af31570e5a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:43.315603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fce9a-c89b-437d-9a0a-04af31570e5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:43.315883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fce9a-c89b-437d-9a0a-04af31570e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:43.321316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:43.383573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-590fce9a-c89b-437d-9a0a-04af31570e5a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:43.384770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-590fce9a-c89b-437d-9a0a-04af31570e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:43.487300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 680/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:43.770512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:43.772130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:43.822077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:43.877377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbb93-d174-4d30-8bc4-7c95135790fa None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:43.949989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:43.950596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:43.950876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:43.951335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:43.952932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:44.047528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:44.065015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:44.066606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953de67a-a601-483d-b821-20b8849cf662 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:44.085095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 663/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:46.889887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:46.890465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:46.890716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:46.892978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 681/1344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:46.898001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2e7c-4c5b-4327-b2d6-fb3cd7a0bf63 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:46.898449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2e7c-4c5b-4327-b2d6-fb3cd7a0bf63 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:46.898614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2e7c-4c5b-4327-b2d6-fb3cd7a0bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:46.965940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-659b2e7c-4c5b-4327-b2d6-fb3cd7a0bf63 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:46.967163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-659b2e7c-4c5b-4327-b2d6-fb3cd7a0bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:47.071139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 664/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:47.350930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:47.352534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:47.441293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:47.458646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb626629-c031-4323-a62f-8801ee59cd8a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:47.534969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:47.535513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:47.535789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:47.536053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:47.537631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:47.646752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:47.648232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106aff-ef4c-4b50-b077-7357fdc29b71 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:47.666944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 682/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:05:51.740527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:51.741001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:51.741173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:51.742889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 665/1347] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:51.749252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f93b-f2e5-42d8-be8f-2dd349367f46 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:51.749726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f93b-f2e5-42d8-be8f-2dd349367f46 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:51.749824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f93b-f2e5-42d8-be8f-2dd349367f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:51.765126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:51.817268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2999f93b-f2e5-42d8-be8f-2dd349367f46 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:51.818457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2999f93b-f2e5-42d8-be8f-2dd349367f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:51.915278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 683/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:05:52.199346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:05:52.201011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:52.259181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:52.307521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2702c-060c-4e57-a8e1-c5cb2d028eef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:05:52.380994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:05:52.381598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:52.381875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:52.382161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:52.383762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:52.488504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:05:52.492669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:05:52.494119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8363c-03e4-4589-ad67-4c1dc56b0d0c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:05:52.511933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 666/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:05:57.438019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd734-8c3f-433c-a366-f73ed68ba796 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:57.438606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd734-8c3f-433c-a366-f73ed68ba796 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:57.438606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd734-8c3f-433c-a366-f73ed68ba796 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:57.439956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 684/1350] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:05:57.445736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1f55-4187-4562-adf0-404c39983a2d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:05:57.446170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1f55-4187-4562-adf0-404c39983a2d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:05:57.446270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1f55-4187-4562-adf0-404c39983a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:05:57.534240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-24be1f55-4187-4562-adf0-404c39983a2d None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:05:57.537856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-24be1f55-4187-4562-adf0-404c39983a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:05:57.684121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 667/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:01.813967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80741-9c8d-4f41-a82d-10ad343fe8e9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:01.814833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80741-9c8d-4f41-a82d-10ad343fe8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:01.815152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80741-9c8d-4f41-a82d-10ad343fe8e9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:01.816653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 685/1352] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:01.821677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8780-a724-4f06-932b-c2902d93cdb9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:01.822115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8780-a724-4f06-932b-c2902d93cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:01.822416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8780-a724-4f06-932b-c2902d93cdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:01.879186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:01.904614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6edf8780-a724-4f06-932b-c2902d93cdb9 None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:01.905824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6edf8780-a724-4f06-932b-c2902d93cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:01.913378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=59 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:02.024548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 668/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:03.322613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7749-c40f-4240-a5ca-7d1466676d23 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:03.323164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7749-c40f-4240-a5ca-7d1466676d23 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:03.323308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7749-c40f-4240-a5ca-7d1466676d23 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:03.324779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 686/1354] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:03.330514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1a18-b832-49ff-ad06-4d36a6cdb1d9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:03.330925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1a18-b832-49ff-ad06-4d36a6cdb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:03.331138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1a18-b832-49ff-ad06-4d36a6cdb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:03.407625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c06c1a18-b832-49ff-ad06-4d36a6cdb1d9 None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:03.408725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c06c1a18-b832-49ff-ad06-4d36a6cdb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:03.450670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:03.516373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 669/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:07.249966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728976-bb81-4238-b97e-374836cfdece None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:07.250860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728976-bb81-4238-b97e-374836cfdece None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:07.251311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728976-bb81-4238-b97e-374836cfdece None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:07.255664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 687/1356] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:07.259216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36968d-8461-45ff-aeac-7dfa870fbb98 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:07.259705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36968d-8461-45ff-aeac-7dfa870fbb98 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:07.259810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36968d-8461-45ff-aeac-7dfa870fbb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:07.344046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eb36968d-8461-45ff-aeac-7dfa870fbb98 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:07.345324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eb36968d-8461-45ff-aeac-7dfa870fbb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:07.446055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 670/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:07.742324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:07.742888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:07.743407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:07.745271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 688/1358] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 12 14:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:07.754415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd3f0b-a8b5-49f2-8da0-211931e1d73e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:07.754715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd3f0b-a8b5-49f2-8da0-211931e1d73e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:07.754968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd3f0b-a8b5-49f2-8da0-211931e1d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:07.790574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:07.856809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a1bd3f0b-a8b5-49f2-8da0-211931e1d73e None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:07.857985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1bd3f0b-a8b5-49f2-8da0-211931e1d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:08.007637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 671/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 12 14:06:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:06:08.015280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:08.017164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:08.178512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268865-f465-487d-830c-abbb970fe2ae None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:08.254062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:08.297230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:08.297773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:08.298036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:08.298300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:08.300068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:08.397639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:08.399314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b9254-df28-4b37-b10c-3c3f99206bb7 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:08.419095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 689/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:10.801477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:10.801976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:10.801976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:10.807538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 672/1361] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:10.808754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170e23-dccf-435b-97aa-c3cfd01723cd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:10.809340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170e23-dccf-435b-97aa-c3cfd01723cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:10.809340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170e23-dccf-435b-97aa-c3cfd01723cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:10.899444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65170e23-dccf-435b-97aa-c3cfd01723cd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:10.900706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65170e23-dccf-435b-97aa-c3cfd01723cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:10.941793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:11.006552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 690/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:06:11.294046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:11.295708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:11.369876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:11.479889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616075c-682c-4e36-9b4b-4fbd11c0d097 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:11.609896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:11.610502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:11.610787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:11.611056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:11.612664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:11.635344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:11.704862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:11.706502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0c016-1d94-4340-9934-70f2d03cdd20 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:11.724918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 673/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:14.188299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b66f-7ad0-4c7e-b392-ed90e33d5d68 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:14.188850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b66f-7ad0-4c7e-b392-ed90e33d5d68 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:14.188850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b66f-7ad0-4c7e-b392-ed90e33d5d68 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:14.190357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 691/1364] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:14.195431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d48-50f5-4602-afa5-fcd5a0a38cfe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:14.195857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d48-50f5-4602-afa5-fcd5a0a38cfe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:14.196054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d48-50f5-4602-afa5-fcd5a0a38cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:14.269680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ade65d48-50f5-4602-afa5-fcd5a0a38cfe None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:14.270885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ade65d48-50f5-4602-afa5-fcd5a0a38cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:14.371653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:14.380837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 674/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:14.670598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:14.670910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:14.671364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:14.672886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 692/1366] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 12 14:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:14.678421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b18-6f17-42a7-a12d-ebf78593edf1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:14.678705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b18-6f17-42a7-a12d-ebf78593edf1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:14.679149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b18-6f17-42a7-a12d-ebf78593edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:14.758966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6a431b18-6f17-42a7-a12d-ebf78593edf1 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:14.760195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6a431b18-6f17-42a7-a12d-ebf78593edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:14.881687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 675/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 12 14:06:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:14.889893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:14.891433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:15.045729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390bdd-a047-464a-b599-406f4ba17910 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:15.066775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:15.177988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:15.178611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:15.178889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:15.179194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:15.180790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:15.278512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:15.280348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfd8ef-6f10-4840-a23b-39f797d8b9fd service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:15.299461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 693/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:15.507198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8c5f-139a-43b4-9903-39fc6eb99469 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:15.507735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8c5f-139a-43b4-9903-39fc6eb99469 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:15.507735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f8c5f-139a-43b4-9903-39fc6eb99469 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:15.509123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 676/1369] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:15.517636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef7b5-e006-45c8-8cdb-76828ac906db None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:15.517968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef7b5-e006-45c8-8cdb-76828ac906db None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:15.518199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef7b5-e006-45c8-8cdb-76828ac906db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:15.554988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:15.602143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-363ef7b5-e006-45c8-8cdb-76828ac906db None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:15.603627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-363ef7b5-e006-45c8-8cdb-76828ac906db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:15.707435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 694/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:16.040357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:16.040649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:16.040934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:16.042868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 677/1371] 10.222.0.20 () {54 vars in 964 bytes} [Mon Sep 12 14:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:06:16.047999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c1b6-7a5d-4372-8231-5bdbd347b20a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:16.048293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c1b6-7a5d-4372-8231-5bdbd347b20a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:16.048574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c1b6-7a5d-4372-8231-5bdbd347b20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:16.133468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2eb7c1b6-7a5d-4372-8231-5bdbd347b20a None None] MFA Rules not processed for user `37a474226dec48deb747b50c68c5b14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:16.134652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2eb7c1b6-7a5d-4372-8231-5bdbd347b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:16.183433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:16.214356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 695/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Sep 12 14:06:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:16.222495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:16.224037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:16.280435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:16.337586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b3905-3a47-41e6-9172-e7d614a64e01 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:16.426366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:16.427172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:16.427598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:16.427984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:16.429915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:16.551302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:16.566765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:16.568137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd239cf-c06c-42a1-a5f4-3b39dc9647a7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:16.595409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 678/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:17.517044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:17.517608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:17.517608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:17.518995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 696/1374] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:17.524317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168e6e-278d-4e8f-9d5c-7c1be85554ef None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:17.524606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168e6e-278d-4e8f-9d5c-7c1be85554ef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:17.524881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168e6e-278d-4e8f-9d5c-7c1be85554ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:17.590918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a8168e6e-278d-4e8f-9d5c-7c1be85554ef None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:17.592141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8168e6e-278d-4e8f-9d5c-7c1be85554ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:17.689940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 679/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:17.974490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:17.976030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:18.138739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f125ed-a44f-46e2-b770-060913f61d18 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:18.193383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:18.258836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:18.259488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:18.259771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:18.260046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:18.262226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:18.355052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:18.356707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cbe2c-439e-4f35-8603-92914d0435fd service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:18.375465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 697/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:20.610237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:20.610763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:20.610763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:20.612308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 680/1377] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:20.618368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638638-6853-48d6-8c7f-9ba646e6a43e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:20.618962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638638-6853-48d6-8c7f-9ba646e6a43e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:20.618962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638638-6853-48d6-8c7f-9ba646e6a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:20.695078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0638638-6853-48d6-8c7f-9ba646e6a43e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:20.696282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0638638-6853-48d6-8c7f-9ba646e6a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:20.703737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:20.804544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 698/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:21.101147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:21.102848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:21.167773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:21.265364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dd77f-f64e-46c7-9561-f4fb2a370c03 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:21.380790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:21.381462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:21.381841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:21.382214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:21.383922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:21.404481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:21.477991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:21.479813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04378058-4cba-4bda-a454-e20d3ae47b91 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:21.499121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 681/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:23.704041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:23.704640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:23.704640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:23.706070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 699/1380] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:23.711294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcba6ca-7f2e-41da-bfcb-650b51c2ab29 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:23.711696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcba6ca-7f2e-41da-bfcb-650b51c2ab29 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:23.711860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcba6ca-7f2e-41da-bfcb-650b51c2ab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:23.779492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5fcba6ca-7f2e-41da-bfcb-650b51c2ab29 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:23.780677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fcba6ca-7f2e-41da-bfcb-650b51c2ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:23.890949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:23.899700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 682/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:24.210833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:24.212377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:24.347731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:24.359134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665eeb5-3ddb-44e7-8fac-07b3c9be6911 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:24.470787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:24.471440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:24.471723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:24.471998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:24.473613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:24.577686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:24.579887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800858-9c3e-4649-a31e-8c566623f7f0 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:24.591378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:24.601053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 700/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:26.812094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:26.812632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:26.812632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:26.814080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 683/1383] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:26.821142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5c45-b4b7-4e63-8922-32be6f891f29 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:26.821591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5c45-b4b7-4e63-8922-32be6f891f29 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:26.821886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5c45-b4b7-4e63-8922-32be6f891f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:26.896100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fc4e5c45-b4b7-4e63-8922-32be6f891f29 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:26.897343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fc4e5c45-b4b7-4e63-8922-32be6f891f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:27.008435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 701/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:27.367079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:27.368686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:27.530293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a44f-946a-42a9-9be5-bf5515890a63 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:27.603129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:27.657764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:27.658539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:27.658864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:27.659227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:27.661329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:27.765190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:27.767326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b9eb0-4415-4e80-8b07-eb1f31d4525e service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:27.788256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 684/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:29.945896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:29.946478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:29.946478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:29.948367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 702/1386] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:29.953553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2fba-2562-4dd3-bc48-e9f627cdeea1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:29.953960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2fba-2562-4dd3-bc48-e9f627cdeea1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:29.954103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2fba-2562-4dd3-bc48-e9f627cdeea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:30.021732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-840f2fba-2562-4dd3-bc48-e9f627cdeea1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:30.022981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-840f2fba-2562-4dd3-bc48-e9f627cdeea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:30.055887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:30.123830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 685/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:30.414386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:30.416045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:30.493964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:30.568537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ffcdf-8a5d-4f72-913d-c8ddf8493961 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:30.704711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:30.705402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:30.705761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:30.706064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:30.708046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:30.756279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:30.812639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:30.814633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00221c-bc42-4784-aaf9-5a0df4ab11f0 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:30.834762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 703/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:33.075621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:33.076132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:33.076132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:33.077488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 686/1389] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:33.082988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532330d-3d40-459f-9db5-c2e78297b11f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:33.083468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532330d-3d40-459f-9db5-c2e78297b11f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:33.083574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532330d-3d40-459f-9db5-c2e78297b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:33.154025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2532330d-3d40-459f-9db5-c2e78297b11f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:33.155279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2532330d-3d40-459f-9db5-c2e78297b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:33.257294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 704/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:33.552603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:33.554207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:33.701203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9b7fb-cf08-4dcb-bb45-bb2ea8087715 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:33.717721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:33.815112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:33.815593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:33.815892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:33.816153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:33.817764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:33.907667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:33.909306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35207-c1c9-48fd-aa17-29b221006b1d service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:33.927634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 687/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:34.905924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0808-040d-4681-9499-0b93203b56e4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:34.906472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0808-040d-4681-9499-0b93203b56e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:34.906595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea0808-040d-4681-9499-0b93203b56e4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:34.907907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 705/1392] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:34.913380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751536fa-d907-4de7-80ce-4e592da53491 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:34.913764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751536fa-d907-4de7-80ce-4e592da53491 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:34.913930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751536fa-d907-4de7-80ce-4e592da53491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:34.939119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:34.979567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-751536fa-d907-4de7-80ce-4e592da53491 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:34.980797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-751536fa-d907-4de7-80ce-4e592da53491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:35.074957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 688/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:35.371709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:35.371999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:35.372277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:35.373629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 706/1394] 10.222.0.20 () {54 vars in 966 bytes} [Mon Sep 12 14:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:35.380741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d12f-0bd3-4996-a578-a7789ac05317 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:35.381037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d12f-0bd3-4996-a578-a7789ac05317 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:35.381312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d12f-0bd3-4996-a578-a7789ac05317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:35.474449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c298d12f-0bd3-4996-a578-a7789ac05317 None None] MFA Rules not processed for user `fc7bd82c6d3b4048a3a0256b8802a86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:35.475687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c298d12f-0bd3-4996-a578-a7789ac05317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:35.518664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:35.555230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 689/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Mon Sep 12 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:35.564553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:35.566138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:35.580397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:35.673564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10fa0f-95db-47b7-bfaf-fded5d6b462d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:35.770200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:35.770809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:35.771119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:35.771396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:35.774322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:35.846278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:35.889509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:35.890951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71790c78-7e5c-42ec-85d9-69414dd12374 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:35.909861 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 707/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:36.126169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.126780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.126780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.128138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 690/1397] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:06:36.134316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5feb-0d24-4424-a0c9-4de2f007b6d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.134596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5feb-0d24-4424-a0c9-4de2f007b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.134868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5feb-0d24-4424-a0c9-4de2f007b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.206436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-49eb5feb-0d24-4424-a0c9-4de2f007b6d9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:36.207674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49eb5feb-0d24-4424-a0c9-4de2f007b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:36.321712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 708/1398] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:36.618946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:36.621049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:36.666441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f39090-4826-4ae1-a85b-ee40256bc810 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.666725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f39090-4826-4ae1-a85b-ee40256bc810 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.667052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f39090-4826-4ae1-a85b-ee40256bc810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.697134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:36.742286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a4f39090-4826-4ae1-a85b-ee40256bc810 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:36.743551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a4f39090-4826-4ae1-a85b-ee40256bc810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:36.777670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aaf14-e856-49f4-80e7-22dab6bd17ff None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:36.826454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:36.833958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 709/1399] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:06:36.880009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475558-fb19-450b-b275-2d14837e8c58 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.880305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475558-fb19-450b-b275-2d14837e8c58 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.880576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475558-fb19-450b-b275-2d14837e8c58 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.881995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 710/1400] 10.222.0.20 () {54 vars in 943 bytes} [Mon Sep 12 14:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:06:36.888480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcecbec-4ab8-44ac-bae5-f2ebcbe35ffc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.888767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcecbec-4ab8-44ac-bae5-f2ebcbe35ffc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.889037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcecbec-4ab8-44ac-bae5-f2ebcbe35ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.895599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:36.896217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:36.896496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:36.896766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:36.898379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:36.966337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0dcecbec-4ab8-44ac-bae5-f2ebcbe35ffc None None] MFA Rules not processed for user `e2c9f5ffc72a45848735d1f5d1f3f25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:36.967597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0dcecbec-4ab8-44ac-bae5-f2ebcbe35ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:36.988802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:36.990450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:37.009312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 691/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:37.021655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:37.077228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 711/1402] 10.222.0.20 () {58 vars in 1040 bytes} [Mon Sep 12 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:06:37.086735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:37.088030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:37.149536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:37.186874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364081a2-30c8-43ab-94b3-f521e16cc3d1 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:37.295615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:37.296247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:37.296560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:37.296866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:37.298538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:37.380912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:37.382448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6a1c-edb2-4da5-90ae-e13f3302c790 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:37.387583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:37.391716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 692/1403] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:06:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 14:06:39.220070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:39.220609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:39.220609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:39.221951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 712/1404] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:39.228468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938d8fb-9c65-4153-963b-4c1bea15871b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:39.229361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938d8fb-9c65-4153-963b-4c1bea15871b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:39.230256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938d8fb-9c65-4153-963b-4c1bea15871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:39.304729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0938d8fb-9c65-4153-963b-4c1bea15871b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:39.306029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0938d8fb-9c65-4153-963b-4c1bea15871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:39.414550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 693/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:39.706004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:39.707555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:39.927882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3eef5-8290-4f44-888a-f03186cd32de None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:39.960705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:40.053192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:40.053797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:40.054070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:40.054341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:40.055964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:40.156063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:40.157990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7739d8-6677-440b-a963-5a6cc99e68be service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:40.177119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 713/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:42.396580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:42.397446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:42.397724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:42.399099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 694/1407] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:06:42.405614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddb5d-b9d7-43ec-8119-03b775b906ba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:42.406050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddb5d-b9d7-43ec-8119-03b775b906ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:42.406155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddb5d-b9d7-43ec-8119-03b775b906ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:42.449475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:42.477104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-862ddb5d-b9d7-43ec-8119-03b775b906ba None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:06:42.479088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-862ddb5d-b9d7-43ec-8119-03b775b906ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:42.589882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 714/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:06:42.880004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:06:42.881888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:42.967249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:43.038724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383487f2-2e86-4bfb-aee6-a925bba77b5a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:06:43.175368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:06:43.176366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:06:43.176858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:06:43.177348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:06:43.179352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:06:43.226481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:43.282764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:06:43.284762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de157f98-5478-4ce4-86d3-d79942b6bf82 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:06:43.303726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 695/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:06:52.587292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=51 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:53.300805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=27 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:00.336010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117e64-60d3-4b88-842e-f4e18b6144d4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:00.336562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117e64-60d3-4b88-842e-f4e18b6144d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:00.336562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117e64-60d3-4b88-842e-f4e18b6144d4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:00.337913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 715/1410] 10.222.0.20 () {54 vars in 918 bytes} [Mon Sep 12 14:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:00.342974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c51bc-a3e4-47a1-b82b-a7be176406fe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:00.343399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c51bc-a3e4-47a1-b82b-a7be176406fe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:00.343553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c51bc-a3e4-47a1-b82b-a7be176406fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:00.418479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-733c51bc-a3e4-47a1-b82b-a7be176406fe None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:00.419626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-733c51bc-a3e4-47a1-b82b-a7be176406fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:00.528318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 696/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Sep 12 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:00.542533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd405-84f9-4a68-929e-be3b292e4528 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:00.542813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd405-84f9-4a68-929e-be3b292e4528 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:00.543121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dd405-84f9-4a68-929e-be3b292e4528 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:00.544454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 716/1412] 10.222.0.20 () {54 vars in 918 bytes} [Mon Sep 12 14:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:00.549060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d985ef-95ec-4318-a0dc-fc2dbfc1e2a1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:00.549342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d985ef-95ec-4318-a0dc-fc2dbfc1e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:00.549612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d985ef-95ec-4318-a0dc-fc2dbfc1e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:00.622671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:00.625543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a5d985ef-95ec-4318-a0dc-fc2dbfc1e2a1 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:00.627424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a5d985ef-95ec-4318-a0dc-fc2dbfc1e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:00.740018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 697/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Sep 12 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:03.296653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:03.297183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:03.297298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:03.298607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:03.303995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c45b-ccbf-4459-8449-cb1e08c83560 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:03.304422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c45b-ccbf-4459-8449-cb1e08c83560 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:03.304571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c45b-ccbf-4459-8449-cb1e08c83560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:03.371262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2631c45b-ccbf-4459-8449-cb1e08c83560 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:03.372421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2631c45b-ccbf-4459-8449-cb1e08c83560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:03.425768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:03.467487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:03.760949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:03.762508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:03.912062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673c96f-b414-476e-8dc5-1f99d73bb1b3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:03.985389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:04.027451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:04.027999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:04.028275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:04.028544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:04.030175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:04.121999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:04.123641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983c8da-2d7c-4994-ae21-2b04d2dd6a20 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:04.141474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 718/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:05.277406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:05.277936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:05.277936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:05.279341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:05.285416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be466-27cc-4b23-8c89-d1d80c7b95e3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:05.285803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be466-27cc-4b23-8c89-d1d80c7b95e3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:05.286043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be466-27cc-4b23-8c89-d1d80c7b95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:05.361232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b57be466-27cc-4b23-8c89-d1d80c7b95e3 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:05.362365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b57be466-27cc-4b23-8c89-d1d80c7b95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:05.389450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:05.464202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:05.619086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:05.621049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:05.763999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608959b-e032-4430-89ce-b56c7e3d16ce None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:05.803156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:05.898397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:05.898916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:05.899235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:05.899508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:05.901762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:05.996380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:05.997995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e6b0d-55a7-4b59-b5dc-d7da55e2e802 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:06.015897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 700/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:07.138406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:07.138913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:07.139178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:07.140322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:07.146505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192294-ea2f-4427-8919-faeb1fe38704 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:07.146940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192294-ea2f-4427-8919-faeb1fe38704 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:07.147134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192294-ea2f-4427-8919-faeb1fe38704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:07.209862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:07.232739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6b192294-ea2f-4427-8919-faeb1fe38704 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:07.233957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b192294-ea2f-4427-8919-faeb1fe38704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:07.332259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:07.490285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:07.491902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:07.638120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ff37e-22f9-4e3d-b66e-9107f6a03d56 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:07.650210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:07.751776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:07.752379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:07.752655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:07.752921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:07.754512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:07.846004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:07.847637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10444c94-3b01-4526-a6ad-335a2fdff1ed service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:07.865670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 721/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:08.973639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:08.974195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:08.974195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:08.975639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:08.981819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c33d-0099-4c15-ac47-c10263deedcb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:08.982235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c33d-0099-4c15-ac47-c10263deedcb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:08.982372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c33d-0099-4c15-ac47-c10263deedcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:09.002233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:09.057573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f221c33d-0099-4c15-ac47-c10263deedcb None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:09.058754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f221c33d-0099-4c15-ac47-c10263deedcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:09.154414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:09.301985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:09.303516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:09.410075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:09.445526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a329df-904a-4c5f-bff9-8182e4129490 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:09.554992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:09.555627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:09.555904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:09.556176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:09.558283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:09.632292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:09.646766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:09.648410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1c78-588e-444f-85de-7394a9f6ea6b service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:09.666075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 703/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:10.772338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:10.772978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:10.772978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:10.774243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:10.780819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe0e5e-d93f-453b-a025-a4f0fbb42942 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:10.781339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe0e5e-d93f-453b-a025-a4f0fbb42942 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:10.781587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe0e5e-d93f-453b-a025-a4f0fbb42942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:10.858997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d4fe0e5e-d93f-453b-a025-a4f0fbb42942 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:10.860497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d4fe0e5e-d93f-453b-a025-a4f0fbb42942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:10.960482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:07:11.108013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:11.109698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:11.193320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:11.254956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b392b1-b730-4051-a92f-4dfdc71b5394 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:11.366416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:11.366944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:11.367252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:11.367525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:11.369148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:11.416890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:11.457168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:11.458743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a769c-5059-4b6a-9f94-d5d65d640d9c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:11.476203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 724/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:12.526065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:12.526631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:12.526631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:12.527979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:12.534040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc59a-dc19-4b01-bf91-df714d26c614 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:12.534497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc59a-dc19-4b01-bf91-df714d26c614 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:12.534607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc59a-dc19-4b01-bf91-df714d26c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:12.609275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7bddc59a-dc19-4b01-bf91-df714d26c614 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:12.610716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7bddc59a-dc19-4b01-bf91-df714d26c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:12.705185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:12.857406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:12.858947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:12.907443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:13.002448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f6f5d-b13d-4edf-9982-22fcdfdee004 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:13.112298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:13.112438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:13.112620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:13.112889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:13.114488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:13.121532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:13.206234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:13.207889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de225e-a044-4133-b20f-0d36b9c27987 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:13.226008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 706/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:14.278449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:14.279048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:14.279048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:14.280363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:14.286517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6160-d214-42b6-b1dc-6c1bfa203689 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:14.286963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6160-d214-42b6-b1dc-6c1bfa203689 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:14.287101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6160-d214-42b6-b1dc-6c1bfa203689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:14.362121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d01b6160-d214-42b6-b1dc-6c1bfa203689 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:14.363297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d01b6160-d214-42b6-b1dc-6c1bfa203689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:14.429282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:14.458135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:14.607711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:14.609249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:14.626520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:14.750743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b34c8e-783a-45f4-881d-59423a706036 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:14.836321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:14.863199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:14.863806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:14.864187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:14.864461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:14.866059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:14.957607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:14.959203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74fd7a-53f7-40fa-bba3-f4cf3c64811d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:14.977709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 727/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:16.022713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:16.023320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:16.023320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:16.024670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:16.031509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23e4f2-39dc-47d8-aa61-640128547436 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:16.031924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23e4f2-39dc-47d8-aa61-640128547436 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:16.032072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23e4f2-39dc-47d8-aa61-640128547436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:16.106489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cf23e4f2-39dc-47d8-aa61-640128547436 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:16.107826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cf23e4f2-39dc-47d8-aa61-640128547436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:16.150454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:16.204809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:16.353253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:16.355319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:16.498017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a78d-ed57-4146-8622-f8ebc2fe07ff None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:16.551451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:16.610476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:16.611021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:16.611337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:16.611607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:16.613218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:16.702509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:16.704197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce68e-c087-4746-a020-3efd879960e6 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:16.722238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 709/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:17.766584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:17.767180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:17.767180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:17.768540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:17.774530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc2bd-5ac1-4d91-8b1b-1679b83b1e44 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:17.774932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc2bd-5ac1-4d91-8b1b-1679b83b1e44 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:17.775096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc2bd-5ac1-4d91-8b1b-1679b83b1e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:17.850624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-155cc2bd-5ac1-4d91-8b1b-1679b83b1e44 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:17.851776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-155cc2bd-5ac1-4d91-8b1b-1679b83b1e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:17.854425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:17.949283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:18.097526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:18.099111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:18.245480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f01d6-76dc-4d6a-bc1b-28c4c3aa8b1d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:18.272190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:18.355574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:18.356176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:18.356453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:18.356724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:18.358327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:18.445411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:18.446915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8934f-f4a1-4fc6-98de-2381f09dbefa service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:18.465005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 730/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:20.527644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:20.528180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:20.528180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:20.529564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:20.534871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee8e-4d16-408e-83c0-1df57a38bbe4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:20.535313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee8e-4d16-408e-83c0-1df57a38bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:20.535447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee8e-4d16-408e-83c0-1df57a38bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:20.575197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:20.600949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0e8ee8e-4d16-408e-83c0-1df57a38bbe4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:20.602157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0e8ee8e-4d16-408e-83c0-1df57a38bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:20.698392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:20.981626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:20.983240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:21.083884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c7409-0e41-43cd-9e7b-de28eb9c6994 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:21.116449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:21.158465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:21.159004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:21.159321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:21.159594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:21.161229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:21.286320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:21.287812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2bf8-05fc-41b4-9efd-671336397f7f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:21.305225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 712/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:23.591633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:23.592161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:23.592161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:23.593568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:23.599070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5111-c059-4363-9c10-4013153f7526 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:23.599480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5111-c059-4363-9c10-4013153f7526 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:23.599613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5111-c059-4363-9c10-4013153f7526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:23.664814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b75f5111-c059-4363-9c10-4013153f7526 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:23.666053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b75f5111-c059-4363-9c10-4013153f7526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:23.679366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:23.761208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:24.052068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:24.053938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:24.157328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fdd22-c134-43ec-9a13-e15df9173527 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:24.169879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:24.231110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:24.231707 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:24.231984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:24.232252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:24.233838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:24.341043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:24.342405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85777694-6a19-4929-9f9d-004a1a5a91bb service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:24.360583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 733/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:26.795928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:26.796495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:26.796495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:26.797874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:26.803134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b590-a4ec-49cc-ae92-9f2e341280ea None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:26.803518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b590-a4ec-49cc-ae92-9f2e341280ea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:26.803693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b590-a4ec-49cc-ae92-9f2e341280ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:26.854761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:26.874631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8740b590-a4ec-49cc-ae92-9f2e341280ea None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:26.875883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8740b590-a4ec-49cc-ae92-9f2e341280ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:26.971199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:27.258110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:27.259716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:27.360464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62fc5b-4cbf-4aa5-a561-eb4035b95404 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:27.400391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:27.434171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:27.434777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:27.435087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:27.435361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:27.436965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:27.544670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:27.546124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bf679-ef91-45bd-bd38-0c1d299ac2d5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:27.565409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 715/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:29.829770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:29.830332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:29.830332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:29.831703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:29.837145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742c71-8515-4118-9a53-65e04174cc3a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:29.837552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742c71-8515-4118-9a53-65e04174cc3a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:29.837695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742c71-8515-4118-9a53-65e04174cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:29.902662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-91742c71-8515-4118-9a53-65e04174cc3a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:29.903903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-91742c71-8515-4118-9a53-65e04174cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:29.924247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:30.000389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:30.294727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:30.296306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:30.395690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da66d-cc8e-47e1-a18d-1df0efaf245f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:30.416735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:30.468704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:30.469301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:30.469578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:30.469842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:30.471457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:30.578905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:30.580368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7addd-8a22-41c9-b565-b3171789f705 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:30.601723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 736/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:32.779016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:32.779595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:32.779595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:32.781021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:32.786379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca42e3-a993-4877-bf0d-194b93b02858 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:32.786803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca42e3-a993-4877-bf0d-194b93b02858 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:32.786938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca42e3-a993-4877-bf0d-194b93b02858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:32.850010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:32.852799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0eca42e3-a993-4877-bf0d-194b93b02858 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:32.854634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0eca42e3-a993-4877-bf0d-194b93b02858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:32.948924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:33.229601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:33.231224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:33.332608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9972c3-989f-4b36-86c1-ac0a86490503 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:33.381830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:33.405995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:33.406599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:33.406881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:33.407189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:33.408776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:33.514936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:33.516412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a26f2-6015-4831-9949-c7535c842e1a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:33.534311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 718/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:35.727798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:35.728328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:35.728448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:35.729722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:35.735477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244384-0f97-4d21-8efe-00e91af79f43 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:35.735896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244384-0f97-4d21-8efe-00e91af79f43 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:35.736032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244384-0f97-4d21-8efe-00e91af79f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:35.918559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7b244384-0f97-4d21-8efe-00e91af79f43 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:35.919816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7b244384-0f97-4d21-8efe-00e91af79f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:35.949099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:36.016046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:36.300561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:36.302093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:36.404065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed7f0-91ab-4dfd-939a-076601073b5a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:36.432052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:36.476320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:36.476915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:36.477189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:36.477457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:36.479643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:36.707134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:36.708468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaf3e3-894a-484b-8439-5a35f61ad920 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:36.727072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 739/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:38.926734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:38.927317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:38.927425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:38.928799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:38.934867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be32e6-4321-403b-9a12-9614e4be23bc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:38.935300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be32e6-4321-403b-9a12-9614e4be23bc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:38.935450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be32e6-4321-403b-9a12-9614e4be23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:39.000071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-43be32e6-4321-403b-9a12-9614e4be23bc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:39.001266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43be32e6-4321-403b-9a12-9614e4be23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:39.009382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:39.096014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:39.379346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:39.380882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:39.482440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ce0ac-eb91-4850-bd7b-912068ab89e0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:39.536339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:39.554632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:39.555265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:39.555548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:39.555823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:39.557447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:39.665776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:39.667251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b5c4-9ff4-41e3-aaf5-8bfffd636845 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:39.684673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 721/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:41.885781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:41.886432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:41.886432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:41.887745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:41.892968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7945-e4fb-4639-8b5f-e51656753198 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:41.893418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7945-e4fb-4639-8b5f-e51656753198 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:41.893527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7945-e4fb-4639-8b5f-e51656753198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:41.957900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-30bd7945-e4fb-4639-8b5f-e51656753198 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:41.959110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-30bd7945-e4fb-4639-8b5f-e51656753198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:41.997629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:42.055522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:42.344013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:42.345545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:42.445479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba7b4-55da-4703-94b6-17556b0cb561 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:42.482336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:42.516798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:42.517391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:42.517665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:42.517932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:42.519521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:42.625953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:42.627379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54231380-1801-4b61-8db0-be7929640fd8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:42.645693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 742/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:44.826658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:44.827238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:44.827238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:44.828658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:07:44.834163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb315-858a-4009-ae56-a5a4c90d027e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:44.834585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb315-858a-4009-ae56-a5a4c90d027e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:44.834729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb315-858a-4009-ae56-a5a4c90d027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:44.902941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a05cb315-858a-4009-ae56-a5a4c90d027e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:44.904179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a05cb315-858a-4009-ae56-a5a4c90d027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:44.922374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:45.000058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:45.285740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:45.287301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:45.389517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed318f-9e9c-43ab-baf8-eea17fd87085 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:45.455272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:45.462991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:45.463640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:45.463920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:45.464193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:45.465826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:45.572860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:45.574306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393f570-b608-41af-b03d-66df8ade22da service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:45.592328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 724/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:47.767189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:47.767833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:47.767833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:47.769077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:07:47.774634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706742e7-34b8-4965-9033-706bf10389b1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:47.775110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706742e7-34b8-4965-9033-706bf10389b1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:47.775254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706742e7-34b8-4965-9033-706bf10389b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:47.841436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-706742e7-34b8-4965-9033-706bf10389b1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:07:47.842635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-706742e7-34b8-4965-9033-706bf10389b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:47.890623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:47.938790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:07:48.222640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:07:48.224285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:48.326258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556839bb-de94-42d6-9b8c-9ca2cfc11e3e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:07:48.373190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:48.398293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:07:48.398912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:07:48.399220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:07:48.399484 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:07:48.401561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:07:48.508137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:07:48.509554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09f87c-73e5-4ea0-87aa-ecfb93b222e2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:07:48.527822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 745/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:57.937369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=22 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:58.525001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=66 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:08.360755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3df16-3429-4b24-b87d-a2b59641834a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:08.361327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3df16-3429-4b24-b87d-a2b59641834a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:08.361327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3df16-3429-4b24-b87d-a2b59641834a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:08.362708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 726/1471] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:08.368024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f29f7-0c2b-4623-877a-0cd33653e6c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:08.368451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f29f7-0c2b-4623-877a-0cd33653e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:08.368546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f29f7-0c2b-4623-877a-0cd33653e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:08.432856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b24f29f7-0c2b-4623-877a-0cd33653e6c6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:08.434035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b24f29f7-0c2b-4623-877a-0cd33653e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:08.533361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 746/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:08.834316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:08.834693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:08.835121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:08.836706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 727/1473] 10.222.0.20 () {54 vars in 966 bytes} [Mon Sep 12 14:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:08:08.842831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64088f-5272-4dc9-8f00-820b1a956bbf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:08.843177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64088f-5272-4dc9-8f00-820b1a956bbf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:08.843454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64088f-5272-4dc9-8f00-820b1a956bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:08.921194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a64088f-5272-4dc9-8f00-820b1a956bbf None None] MFA Rules not processed for user `fc7bd82c6d3b4048a3a0256b8802a86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:08.922398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a64088f-5272-4dc9-8f00-820b1a956bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:08.942913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:08.998695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 747/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Mon Sep 12 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:09.006341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:09.007900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:09.108435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5064-8ced-4513-84c2-2257ea5985bd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:09.180438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:09.181583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:09.181901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:09.182177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:09.183851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:09.236907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:09.294668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:09.296149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c27b2-8c2f-48db-9e7b-d89ceee42e13 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:09.314120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 728/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:11.535435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:11.536000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:11.536000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:11.537328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 748/1476] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:11.542573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986af33-a3ce-488e-bdc0-2dbdd3acba50 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:11.543000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986af33-a3ce-488e-bdc0-2dbdd3acba50 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:11.543173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986af33-a3ce-488e-bdc0-2dbdd3acba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:11.609011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a986af33-a3ce-488e-bdc0-2dbdd3acba50 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:11.610455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a986af33-a3ce-488e-bdc0-2dbdd3acba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:11.704308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 729/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:11.978626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:11.980190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:12.103114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444506c1-c7fa-4652-b430-5f00d722c4ff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:12.153834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:12.198547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:12.199182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:12.199463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:12.199736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:12.200374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:12.202127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:08:12.202127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:08:12.202127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:08:12.203304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd964b2-3f20-455e-9164-b5ec8d141e98 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:12.221603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 749/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 12 14:08:11 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:08:14.392105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:14.392681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:14.392681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:14.393993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 730/1479] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:14.399972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a407e11-616f-4bf8-aba2-b16d6e8dd029 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:14.400371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a407e11-616f-4bf8-aba2-b16d6e8dd029 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:14.400519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a407e11-616f-4bf8-aba2-b16d6e8dd029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:14.465361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a407e11-616f-4bf8-aba2-b16d6e8dd029 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:14.466570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a407e11-616f-4bf8-aba2-b16d6e8dd029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:14.561599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 750/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:14.851337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:14.852899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:14.862712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:14.996126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974587b-b09a-4d4f-8464-13e6e5d71792 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:15.074132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:15.106180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:15.107109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:15.107386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:15.107652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:15.109332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:15.197019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:15.198623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd66ce-8cd1-4351-a7d5-8101dfae5d62 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:15.216032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 731/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:17.561289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:17.561871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:17.561871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:17.563251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 751/1482] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:17.568589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154ee2-fd61-4f24-a92b-62afa02e4af7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:17.569017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154ee2-fd61-4f24-a92b-62afa02e4af7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:17.569178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154ee2-fd61-4f24-a92b-62afa02e4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:17.635453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1c154ee2-fd61-4f24-a92b-62afa02e4af7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:17.636652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1c154ee2-fd61-4f24-a92b-62afa02e4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:17.681856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:17.730381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 732/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:08:18.019511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:18.021120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:18.044658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:18.123703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ff949-638b-4a8d-913f-f3223ea8ab95 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:18.197374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:18.197971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:18.198245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:18.198510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:18.200125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:18.272224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:18.306659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:18.308119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1967-8611-43cd-8c46-1153a1b69ee8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:18.326039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 752/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:20.532582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:20.533143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:20.533143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:20.534468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 733/1485] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:20.540503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ae8f-0aab-4280-b455-ef99ec265a84 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:20.540930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ae8f-0aab-4280-b455-ef99ec265a84 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:20.541080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ae8f-0aab-4280-b455-ef99ec265a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:20.612824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9a86ae8f-0aab-4280-b455-ef99ec265a84 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:20.614140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a86ae8f-0aab-4280-b455-ef99ec265a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:20.709772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 753/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:21.005033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:21.006601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:21.109276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eeedbf-afb7-4aa0-acbf-4be2f9ad5e46 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:21.180914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:21.182432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:21.183148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:21.183441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:21.183935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:21.185929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:21.294044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:21.295443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e6854-e62b-408a-8fa2-df7d5a0c0645 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:21.313293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 734/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:23.589729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:23.590255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:23.590255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:23.591658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 754/1488] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:23.597072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ce15-77ff-4890-beb3-313000aba804 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:23.597517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ce15-77ff-4890-beb3-313000aba804 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:23.597622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ce15-77ff-4890-beb3-313000aba804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:23.663604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1924ce15-77ff-4890-beb3-313000aba804 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:23.665436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1924ce15-77ff-4890-beb3-313000aba804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:23.716345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:23.761670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 735/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:24.053722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:24.055302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:24.091069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:24.162767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd029db-d54f-41b0-aa78-537b31acf264 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:24.235428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:24.236036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:24.236317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:24.236589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:24.238189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:24.317648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:24.346673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:24.348140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd83c-84b6-446e-b842-f9c17d7ca6ba service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:24.365854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 755/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:26.670666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:26.671265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:26.671265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:26.672613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 736/1491] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 12 14:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:08:26.677920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f7c-f7b1-4415-ab61-098195276b10 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:26.678367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f7c-f7b1-4415-ab61-098195276b10 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:26.678475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f7c-f7b1-4415-ab61-098195276b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:26.743958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-06fe2f7c-f7b1-4415-ab61-098195276b10 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:08:26.745162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-06fe2f7c-f7b1-4415-ab61-098195276b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:26.842578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 756/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 12 14:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:08:27.130936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:08:27.132660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:27.234556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013052f2-1e23-4bec-b5ef-0dab872f8b61 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:08:27.306719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:08:27.307524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:08:27.307700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:08:27.307932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:08:27.309526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:08:27.317975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:27.416882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:08:27.418266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c56e5-0a41-46e9-911f-5e1a66a8ccdf service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:08:27.436255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 737/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:08:36.840967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=82 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:37.434052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=50 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:43.991737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:43.992341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:43.992341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.066929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:09:44.068154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:44.169472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 757/1494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:09:44.177356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:44.177825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:44.177927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.254787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:09:44.255960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:44.349363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 738/1495] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:09:44.354445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:44.355659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:44.368283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec1a33-7144-435a-8523-d1ccaa5db75c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:44.429362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:44.462192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:44.462791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:44.463088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:44.463358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.463992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:09:44.464290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:44.465317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:44.465317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:09:44.465317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:09:44.466202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:44.477587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 758/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:09:44.486258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:44.495236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b583e-6889-4bec-b8d3-7e8857bb1436 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:44.554717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:44.588432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:44.589038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:44.589319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:44.589595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.590225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:44.592001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:44.592001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:09:44.592001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:09:44.593200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:44.648564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 739/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:09:44.652732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:44.654244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:44.688040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9828c-0641-4229-b0c3-caf9447d7f7d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:44.780349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:44.780948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:44.781228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:44.781502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.782124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:44.783153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:44.783153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:09:44.783153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:09:44.784360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:44.827392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 759/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:09:44 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:09:44.831717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:44.833630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:44.899976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b247-d42b-4117-be26-7dedc8e21b28 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:44.982138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:44.993877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:44.994507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:44.994790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:44.995084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:44.995733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:44.996754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:44.996754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:09:44.996754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:09:44.997644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:45.010490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 740/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:09:45.014464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:45.016017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.027801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12875f69-5c45-48c6-b3c6-65376f5d2b08 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:45.052206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:45.122119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:45.122735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.123013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.123313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.123955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:45.124965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:45.124965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:09:45.124965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:09:45.125856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc79e80-0faf-437e-9e2e-e2245bb167f9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:45.141115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 760/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:09:45.145182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:45.146710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.180069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a137-29e4-46b6-bdb2-1d2925ead262 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:45.273153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:45.273797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.274070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.274335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] PATH_INFO: `/v3/projects/6e43e9f9985a42aaa070abd4e348de35/users/1d7d6bcad79546f39fe99622dad27bc4/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.295801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e43e9f9985a42aaa070abd4e348de35, user_id=1d7d6bcad79546f39fe99622dad27bc4, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:45.296815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:45.296815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:09:45.296815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:09:45.298742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082828d-89f6-4a7f-8b52-ade8908ffa9c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:45.323284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 741/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:09:45 2022] PUT /identity/v3/projects/6e43e9f9985a42aaa070abd4e348de35/users/1d7d6bcad79546f39fe99622dad27bc4/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:09:45.335572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c4d-4770-49c9-b6dd-7e8c506cd48a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.335858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c4d-4770-49c9-b6dd-7e8c506cd48a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.336135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c4d-4770-49c9-b6dd-7e8c506cd48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.391913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cb4c6c4d-4770-49c9-b6dd-7e8c506cd48a None None] MFA Rules not processed for user `1d7d6bcad79546f39fe99622dad27bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:09:45.393034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cb4c6c4d-4770-49c9-b6dd-7e8c506cd48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.469250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 761/1502] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:09:45.482296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.482579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.482851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.484231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 742/1503] 10.222.0.20 () {54 vars in 964 bytes} [Mon Sep 12 14:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:09:45.489408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ea03-32b2-48b2-8e8c-37d7aa10a873 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.489688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ea03-32b2-48b2-8e8c-37d7aa10a873 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.489960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ea03-32b2-48b2-8e8c-37d7aa10a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.522560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:45.566242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1b15ea03-32b2-48b2-8e8c-37d7aa10a873 None None] MFA Rules not processed for user `37a474226dec48deb747b50c68c5b14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:09:45.567472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1b15ea03-32b2-48b2-8e8c-37d7aa10a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.642374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 762/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Sep 12 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:09:45.650321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:45.651881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.705074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:45.758265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edf55c-f925-4b27-87c4-70eb4877fda9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:45.828848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:45.829445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.829719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.829986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.831627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:45.927394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:45.929292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:45.932704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:45.947008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 743/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:09:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:09:45.993642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aba62-6454-4727-a626-42d9b1b8e9f5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:45.993927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aba62-6454-4727-a626-42d9b1b8e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:45.994204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aba62-6454-4727-a626-42d9b1b8e9f5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:45.995531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 763/1506] 10.222.0.20 () {52 vars in 830 bytes} [Mon Sep 12 14:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:09:45.999187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:46.000388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:46.096457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a3feb-2a7b-43f9-b089-a450a9b5a492 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:46.191390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:46.192108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:46.192212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:46.192459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] PATH_INFO: `/v3/users/1d7d6bcad79546f39fe99622dad27bc4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:46.204793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7d6bcad79546f39fe99622dad27bc4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:46.205823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:46.205823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:09:46.205823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:09:46.207092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:46.217646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:46.273117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7d6bcad79546f39fe99622dad27bc4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:46.282451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7d6bcad79546f39fe99622dad27bc4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:46.282934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7d6bcad79546f39fe99622dad27bc4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:46.283602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7d6bcad79546f39fe99622dad27bc4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:46.297664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7d6bcad79546f39fe99622dad27bc4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:46.325487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 744/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:09:45 2022] DELETE /identity/v3/users/1d7d6bcad79546f39fe99622dad27bc4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:09:46.329909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:46.330404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:46.330509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:46.388127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:09:46.389316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:46.464044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:46.476426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 764/1508] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:09:46.486801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:46.488087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:46.586153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605eb5f-b15a-4a13-92ff-67a837e8aa7b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:46.638965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:46.659256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:46.659863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:46.660138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:46.660404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:46.661977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:46.770215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:46.771687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efc6be-ca67-488f-9e1a-88a8f6284567 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:46.788977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 745/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:09:47.121354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:09:47.122606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:09:47.133943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d964-7c21-4fdd-ac83-520562e94dbd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:09:47.230756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:09:47.231417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:09:47.231690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:09:47.231960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] PATH_INFO: `/v3/projects/6e43e9f9985a42aaa070abd4e348de35` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:09:47.242456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e43e9f9985a42aaa070abd4e348de35)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:09:47.243562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:09:47.243562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:09:47.243562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:09:47.244746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:09:47.301694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e43e9f9985a42aaa070abd4e348de35', 'request_id': 'req-d100fa1c-8f37-43f6-b78d-a5808314b605'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:47.308241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e43e9f9985a42aaa070abd4e348de35', 'request_id': 'req-d100fa1c-8f37-43f6-b78d-a5808314b605'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:47.317298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e43e9f9985a42aaa070abd4e348de35', 'request_id': 'req-d100fa1c-8f37-43f6-b78d-a5808314b605'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:47.346451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] The token cache is being invalidate because project 6e43e9f9985a42aaa070abd4e348de35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:09:47.347116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:47.347230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d100fa1c-8f37-43f6-b78d-a5808314b605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:09:47.348621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 765/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:09:47 2022] DELETE /identity/v3/projects/6e43e9f9985a42aaa070abd4e348de35 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:09:56.786706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=62 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:09:57.344438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:20.563284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:20.563878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:20.563878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:20.565123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:20.570026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d8f9-ffda-499b-8ad0-3d5bd600f704 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:20.570464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d8f9-ffda-499b-8ad0-3d5bd600f704 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:20.570579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d8f9-ffda-499b-8ad0-3d5bd600f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:20.651501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-79b8d8f9-ffda-499b-8ad0-3d5bd600f704 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:20.652701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-79b8d8f9-ffda-499b-8ad0-3d5bd600f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:20.776239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:20.929151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:20.931280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:21.048239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b9d2-6087-4e94-9775-00a5e7eca14e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:21.054354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:21.054968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:21.055280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:21.055558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:21.064460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:21.066594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940829d1-64e9-4d2f-9ac5-cb325a6ba97e service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:21.077846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 747/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:22.153349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee02a-d9ca-4101-91f6-1d9bb5708c07 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:22.153840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee02a-d9ca-4101-91f6-1d9bb5708c07 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:22.153952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ee02a-d9ca-4101-91f6-1d9bb5708c07 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:22.155269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:22.161647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c641cc-7420-4aa0-9a00-f6ab760bc591 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:22.162132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c641cc-7420-4aa0-9a00-f6ab760bc591 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:22.162241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c641cc-7420-4aa0-9a00-f6ab760bc591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:22.181759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-62c641cc-7420-4aa0-9a00-f6ab760bc591 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:22.182948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-62c641cc-7420-4aa0-9a00-f6ab760bc591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:22.190695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:11:22.342403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ee02a-d9ca-4101-91f6-1d9bb5708c07 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:22.357034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ee02a-d9ca-4101-91f6-1d9bb5708c07 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:22.363389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:22.363915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:22.364201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:22.364476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:22.372379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:22.373970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584fe7-7872-4dfa-aa6d-a0396f7100c5 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:22.383233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 768/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:23.056551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e864d-9043-4ac1-a95c-949d9cae28a7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:23.056835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e864d-9043-4ac1-a95c-949d9cae28a7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:23.057159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e864d-9043-4ac1-a95c-949d9cae28a7 None None] PATH_INFO: `/v3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:23.058467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 749/1517] 10.222.0.18 () {54 vars in 925 bytes} [Mon Sep 12 14:11:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:11:23.064950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1dea-5023-444d-9cb6-482a25c9244f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:23.065236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1dea-5023-444d-9cb6-482a25c9244f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:23.065512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1dea-5023-444d-9cb6-482a25c9244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:23.126327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-aabd1dea-5023-444d-9cb6-482a25c9244f None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:23.127584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aabd1dea-5023-444d-9cb6-482a25c9244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:23.145203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:23.198878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 769/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 12 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:26.814633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06a89-5c41-48e5-a321-2f151e521805 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:26.815082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06a89-5c41-48e5-a321-2f151e521805 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:26.815213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06a89-5c41-48e5-a321-2f151e521805 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:26.817105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 750/1519] 10.222.0.20 () {54 vars in 961 bytes} [Mon Sep 12 14:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:26.822032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925df46-65ab-4358-8700-feef7d756151 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:26.822485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925df46-65ab-4358-8700-feef7d756151 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:26.822589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925df46-65ab-4358-8700-feef7d756151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:26.842753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7925df46-65ab-4358-8700-feef7d756151 None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:26.843987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7925df46-65ab-4358-8700-feef7d756151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:26.852695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 770/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Sep 12 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:26.860637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06a89-5c41-48e5-a321-2f151e521805 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:26.873630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06a89-5c41-48e5-a321-2f151e521805 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:26.878961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:26.879593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:26.879867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:26.880135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:26.888026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:26.889595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5565c0-6354-47e1-b3e0-abef4b5c6f95 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:26.899539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 751/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:33.845946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cef7-2a5e-42d0-97e4-6c6e651c6b7f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:33.846519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cef7-2a5e-42d0-97e4-6c6e651c6b7f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:33.846519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cef7-2a5e-42d0-97e4-6c6e651c6b7f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:33.848400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:33.854719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaaa52-0181-4eec-bf1a-00c9925720d9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:33.855162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaaa52-0181-4eec-bf1a-00c9925720d9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:33.855277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaaa52-0181-4eec-bf1a-00c9925720d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:33.874901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-67aaaa52-0181-4eec-bf1a-00c9925720d9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:33.876126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67aaaa52-0181-4eec-bf1a-00c9925720d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:33.883789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:34.040972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5cef7-2a5e-42d0-97e4-6c6e651c6b7f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:34.055359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5cef7-2a5e-42d0-97e4-6c6e651c6b7f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:34.060740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:34.061337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:34.061622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:34.061896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:34.069828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:34.071442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ffef-e91e-43de-8654-a34ba1c18db1 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:34.080622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 772/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:35.140633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e04a-b333-4989-bd44-e40ed5d29b68 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:35.141125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e04a-b333-4989-bd44-e40ed5d29b68 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:35.141230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e04a-b333-4989-bd44-e40ed5d29b68 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:35.142515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 14:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:35.148632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4d9b-6942-43be-b69a-47243a41f277 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:35.149079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4d9b-6942-43be-b69a-47243a41f277 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:35.149187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4d9b-6942-43be-b69a-47243a41f277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:35.170315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ed4f4d9b-6942-43be-b69a-47243a41f277 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:35.171545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed4f4d9b-6942-43be-b69a-47243a41f277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:35.180148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:35.330163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e04a-b333-4989-bd44-e40ed5d29b68 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:35.344940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e04a-b333-4989-bd44-e40ed5d29b68 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:35.350802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:35.351421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:35.351701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:35.351973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:35.359808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:35.361706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3cfe8-9c6a-4a79-b759-b2e9434dc236 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:35.372494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 754/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:39.598025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:39.598606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:39.598606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:39.599973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:39.605109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd889-8f06-4f7a-8199-c2f20b3c3f21 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:39.605509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd889-8f06-4f7a-8199-c2f20b3c3f21 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:39.605665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd889-8f06-4f7a-8199-c2f20b3c3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:39.625560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6fdcd889-8f06-4f7a-8199-c2f20b3c3f21 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:39.626756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6fdcd889-8f06-4f7a-8199-c2f20b3c3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:39.634602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:39.934895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:39.936603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:40.015005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f11c6-ef16-4c21-b2ea-fc7582f3f77b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:40.019055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:40.019656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:40.019931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:40.020196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:40.029125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:40.030544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1cbb-70ba-4de6-86ed-470e170ebce2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:40.040350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 775/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:42.162275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316372-ea38-4470-b0c1-03c1efa049a1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:42.162812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316372-ea38-4470-b0c1-03c1efa049a1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:42.162952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316372-ea38-4470-b0c1-03c1efa049a1 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:42.164253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:42.169626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf39f1-68b0-4050-8d79-9cdcb886f2c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:42.170028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf39f1-68b0-4050-8d79-9cdcb886f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:42.170210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf39f1-68b0-4050-8d79-9cdcb886f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:42.189168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eaaf39f1-68b0-4050-8d79-9cdcb886f2c6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:42.190841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eaaf39f1-68b0-4050-8d79-9cdcb886f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:42.198532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:42.484262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316372-ea38-4470-b0c1-03c1efa049a1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:42.495885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316372-ea38-4470-b0c1-03c1efa049a1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:42.499564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:42.500159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:42.500472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:42.500742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:42.510130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:42.511632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d82e-4bce-4648-858d-f0de9fb7f411 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:42.520790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 757/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:46.200584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:46.201116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:46.201116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:46.202465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:46.208249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0759-5ea1-4f44-80e6-569288d5e301 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:46.208651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0759-5ea1-4f44-80e6-569288d5e301 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:46.208803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0759-5ea1-4f44-80e6-569288d5e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:46.228292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-41ba0759-5ea1-4f44-80e6-569288d5e301 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:46.229483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-41ba0759-5ea1-4f44-80e6-569288d5e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:46.237419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:46.541342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:46.542980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:46.607007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:46.620720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca08df9-a1c3-4755-8a9f-3ee1231609e6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:46.624329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:46.624956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:46.625236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:46.625510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:46.634793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:46.636246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85937-b1fc-4edd-a9a1-b4efb5333438 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:46.646069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 778/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:48.775598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:48.776201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:48.776201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:48.777502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 14:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:11:48.782626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010928a3-3d03-4158-b9fe-860e891b378a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:48.783108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010928a3-3d03-4158-b9fe-860e891b378a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:48.783216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010928a3-3d03-4158-b9fe-860e891b378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:48.803447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-010928a3-3d03-4158-b9fe-860e891b378a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:11:48.804634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-010928a3-3d03-4158-b9fe-860e891b378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:48.812320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:11:49.121844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:11:49.123532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:11:49.130904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:49.137509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e61a33-0e63-4bb0-8fe9-bd562a501602 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:11:49.141103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:11:49.141699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:11:49.141977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:11:49.142246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:11:49.151466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:11:49.152903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06568d-9232-4f9f-b0b1-ae6b82ce7ae3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:11:49.162602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 760/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:11:58.797988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=11 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:59.157949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:19.931891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9cee-b92c-477e-b951-c16e9fea4fac None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:19.935694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9cee-b92c-477e-b951-c16e9fea4fac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:19.935694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9cee-b92c-477e-b951-c16e9fea4fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:19.956074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a56f9cee-b92c-477e-b951-c16e9fea4fac None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:19.957627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a56f9cee-b92c-477e-b951-c16e9fea4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:19.970731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 780/1540] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:19.982140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:19.982732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:19.982732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.009934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.011178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.024834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 761/1541] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:20.029834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a802f-daa6-4ff4-8cdb-3c34f9b3a50a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.030389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a802f-daa6-4ff4-8cdb-3c34f9b3a50a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.030882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a802f-daa6-4ff4-8cdb-3c34f9b3a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.035813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.045466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64860ab-90c0-424f-989c-70e5eb20e788 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.063060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.063060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.063060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.063060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.063542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.063542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.063542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:20.063542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:13:20.063542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:13:20.063925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.065883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-297a802f-daa6-4ff4-8cdb-3c34f9b3a50a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.067676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-297a802f-daa6-4ff4-8cdb-3c34f9b3a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.076457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 762/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:13:20.089491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.091309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 781/1543] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.100429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9bf4e-eefc-4e59-82d4-6d28efb05b07 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.101022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9bf4e-eefc-4e59-82d4-6d28efb05b07 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.101522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9bf4e-eefc-4e59-82d4-6d28efb05b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.106417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcb803-7b04-49e2-aeab-8470f70cc803 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.128830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.129454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.129730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.130006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.130643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.132653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bde3-220c-48a2-adcc-7a80bbee680c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.140127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f0c9bf4e-eefc-4e59-82d4-6d28efb05b07 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.141774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f0c9bf4e-eefc-4e59-82d4-6d28efb05b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.157827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 782/1544] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:20.160702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.161226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.161754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.196575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.198716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.213057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 783/1545] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.214386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.217027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 763/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:13:20.218420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7b33c-edf6-4827-85e2-63fe0b965cd4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.218711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7b33c-edf6-4827-85e2-63fe0b965cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.218985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7b33c-edf6-4827-85e2-63fe0b965cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.230556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c424-9dce-4d3f-a5aa-08ff8ad93975 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.241163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-11a7b33c-edf6-4827-85e2-63fe0b965cd4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.242359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-11a7b33c-edf6-4827-85e2-63fe0b965cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.290853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.291500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.291776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.292074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.292782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.293578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.294668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122973-674d-4408-8a7e-9ae321fc70ee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.306716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 784/1547] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.313403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668385f3-1370-45ac-b543-8448a9ef6575 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.313587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 764/1548] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.313696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668385f3-1370-45ac-b543-8448a9ef6575 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.313696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668385f3-1370-45ac-b543-8448a9ef6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.313865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.313865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.313865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.330541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.331328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-668385f3-1370-45ac-b543-8448a9ef6575 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.332327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.332454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-668385f3-1370-45ac-b543-8448a9ef6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.340186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 765/1549] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.347529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 785/1550] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.347728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.347828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb392-b91f-41b7-bc09-48ceff2cb912 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.347828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb392-b91f-41b7-bc09-48ceff2cb912 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.347828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb392-b91f-41b7-bc09-48ceff2cb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.357478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c04e-356d-482b-8a8f-fa3c42b00e49 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.362423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.363014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.363462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.363678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.364310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.365330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:20.365330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:13:20.365330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:13:20.365560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cf4fb392-b91f-41b7-bc09-48ceff2cb912 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.366516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b18319-62a2-4679-b891-bd5525c5f06a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.366630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cf4fb392-b91f-41b7-bc09-48ceff2cb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.374488 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 786/1551] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.375681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.375971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.376247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.390689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 766/1552] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.391980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b724-5a55-4eb4-93a4-43a9f11d7632 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.392265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b724-5a55-4eb4-93a4-43a9f11d7632 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.392546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b724-5a55-4eb4-93a4-43a9f11d7632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.398565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.399836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.408150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 787/1553] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.409007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.412285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1447b724-5a55-4eb4-93a4-43a9f11d7632 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.413503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1447b724-5a55-4eb4-93a4-43a9f11d7632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.418466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d7c6-b52b-479f-906a-5e3c6e0f3b17 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.421323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 767/1554] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.422467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce730a-5c2a-4f30-a9b1-d00694c753c2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.422748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce730a-5c2a-4f30-a9b1-d00694c753c2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.423195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce730a-5c2a-4f30-a9b1-d00694c753c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.430410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574674-19b9-44be-865c-43477b99071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.430890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574674-19b9-44be-865c-43477b99071d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.431184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574674-19b9-44be-865c-43477b99071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.431458 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574674-19b9-44be-865c-43477b99071d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.432092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574674-19b9-44be-865c-43477b99071d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.433525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-89574674-19b9-44be-865c-43477b99071d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:20.433525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:13:20.433525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:13:20.435723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574674-19b9-44be-865c-43477b99071d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.445344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3cce730a-5c2a-4f30-a9b1-d00694c753c2 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.446523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3cce730a-5c2a-4f30-a9b1-d00694c753c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.455151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 768/1555] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.456965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead25b-01ca-4dee-96ee-9507cd2cf6e6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.457285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead25b-01ca-4dee-96ee-9507cd2cf6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.457534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead25b-01ca-4dee-96ee-9507cd2cf6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.470883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 788/1556] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.470883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.470883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.470883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.476973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4fead25b-01ca-4dee-96ee-9507cd2cf6e6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.478169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4fead25b-01ca-4dee-96ee-9507cd2cf6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.488670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.489861 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.536897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 769/1557] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.538222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.538514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.538790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.550189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 789/1558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.551478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.559865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.560492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f7028-35c3-4877-bbfb-48c886255db5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.561059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.565099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.566206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.566650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.566769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.567426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.569026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa63078-eb28-424f-b7cb-6d18b9d8a345 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.569504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 770/1559] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.573283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.579401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad379eb8-9c25-441d-91bd-6c4e5fc2cf13 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.585676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 790/1560] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:20.585676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.585676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.586002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.586109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.586197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.586197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.586197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.586428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.586644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.588257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.589791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:20.604019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 771/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.605144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:20.605283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.606482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:20.615663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d939404-a024-4c20-bd47-2430e86fa438 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.621196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 791/1562] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:20.621196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.621440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.621440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.621440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.621708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.622147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.622437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.624107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.628820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d2cce-5a91-45ac-b9f8-1dbb7df26dbf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.633443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.634043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.634322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.634597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.635262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.636940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 772/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.637769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.644802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.648647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176491c-78c5-401e-ae71-5b86a69e6719 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.649487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:20.654284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.654776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.655083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.655487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.656134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.656436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.658079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.663306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 792/1564] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/users => generated 278 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.664352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.669736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 773/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.670401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.680188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c116f-d1d0-45d1-8cc6-170346bfffbd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.681506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1f2e-0dea-4940-a3f8-4189e3350a18 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.684800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.685370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.685708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.685909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.686212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.686532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.686802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.686907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.687103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.687389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.688047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.688349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.688457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.689918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.701078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 774/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.701761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.702660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 793/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.703455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.714495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399968-397b-4ed3-b6d9-7acf5204bb38 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.719130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.719819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.720110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.720388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.720486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22a74-eb4f-498f-b981-182bc54e58ed admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.721021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.722934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.725015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.725603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.725884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.726158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.726791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.728424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.739824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 775/1568] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:20.740967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.751630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965936ad-056b-48e9-9bba-2954b4da2696 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.757013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.757585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.757867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.758141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.761539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 794/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.761690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:20.761690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.761844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.761930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.773852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 776/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:20.774869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.790206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaf410-e57c-45c1-874e-c46f0d1116d6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.820141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f44da5-d325-4a76-8a88-6b1fa07c081e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.825613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.826228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.826721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.827114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.828049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.830028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.845952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.846646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.847063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.847459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.848367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.850535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.858225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 795/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.858892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.868413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 777/1572] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:20.868413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.875657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9433d-ff72-4bbf-8582-f559bbe7a63c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.921438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d37ca-5efe-4fb6-acb2-6be9d088e81d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:20.926693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.927351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.927636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.927979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.928776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.930805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.938741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:20.939485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:20.939794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:20.940085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:20.941325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:20.943299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:20.957991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 796/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.958943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.977603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 778/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:20.977603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:20.990062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:20.991843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.024186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf84e0-517c-4aab-9936-52ebbfe631be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.042375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f856ea-e279-441d-830c-890910030af4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.047009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.047697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.047982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.048259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] PATH_INFO: `/v3/projects/07584918edf649e0a2184edbb2d856e7/users/7253dfa754824c58a9b2a3ad13e61267/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.063270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07584918edf649e0a2184edbb2d856e7, user_id=7253dfa754824c58a9b2a3ad13e61267, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.066684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.079442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 779/1575] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:20 2022] PUT /identity/v3/projects/07584918edf649e0a2184edbb2d856e7/users/7253dfa754824c58a9b2a3ad13e61267/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:21.090343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.090481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.090481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.090481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.090481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.090880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.090880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.119656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 797/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:20 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.119656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.146064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308cf1-d201-43f9-9f10-df486e260874 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.179259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0bb66-cf35-4e7a-9694-2a766d594666 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.183868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.184812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.184812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.185044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.185652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.187586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.202054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.202667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.202958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.203256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.203888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.205974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.213513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 798/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.214483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.235180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 780/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.235180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.243020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d253b-7362-4e1b-997a-dfc8aee51466 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.262697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.271621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.280098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347967-a34b-4d4f-96f2-9992242d6145 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.285264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.285860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.286137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.286407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.287042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.288948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.301152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.301720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.302000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.302272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.302943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.304585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.310344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 799/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.314113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.317510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 781/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.317510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.323612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45a88-50c3-43c2-9bf0-2e1565453af9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.324470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd323-1cdf-4af6-ab90-df5c0586daf7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.328434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.329020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.329297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.329567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.329721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.330157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.330268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.330444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.330740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.331414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.332137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a563e-eb10-4095-888d-7dbdd977add0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.333319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.353688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 800/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.355190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.355483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.355763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.358879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 782/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 282 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.360029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.370329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49379f-648b-4321-9df0-876551b920e3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.375065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.375661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.375949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.376306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.376906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.378954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.384136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] MFA Rules not processed for user `7253dfa754824c58a9b2a3ad13e61267`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:21.385358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:21.400127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 783/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.400127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.410925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d1a-7038-499d-b14e-ffea1372e7fe admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.415733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.416320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.416606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.416880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.417502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.419550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.441436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 784/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.442242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.451538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d4bc-9593-4a8d-badc-454bea90478b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.455211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 801/1585] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:21.456118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.459277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.459964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.460270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.460690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.461371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.463068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.466877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b22a6-e58a-48bf-8798-547adef770d4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.472094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.472709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.472990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.473265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.476580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 785/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.476731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.476818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.476907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.483961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe14d8-4acb-44eb-bd2f-b89e36f90bb0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.486663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 802/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.487949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.492544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.493192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.493474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.493749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] PATH_INFO: `/v3/projects/305adb075c304b03b8036d634d5f80a3/users/1d16fbf8fa384566809e9e2c5150c598/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.499334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb046-aec2-4455-a9e0-730ad879f391 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.503963 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.504551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.504829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.505101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.505734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.507326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.508500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=305adb075c304b03b8036d634d5f80a3, user_id=1d16fbf8fa384566809e9e2c5150c598, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.511169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.517326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 803/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.518844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.526249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 786/1589] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:21 2022] PUT /identity/v3/projects/305adb075c304b03b8036d634d5f80a3/users/1d16fbf8fa384566809e9e2c5150c598/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:21.527350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.529119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad0ae-7aa3-49ff-918d-5683f7c09900 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.586892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.587530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.587805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.588075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.588706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.590288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.599659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f062cd-fa9d-4c5e-9785-abb9f36a02ac admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.600479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 804/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.601286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.608245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.608911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.609232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.609812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.610556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.611547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a6f8-c901-49ef-b38f-c166e754df5b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.612286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.616243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.616826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.617107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.617380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.618011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.619618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.622439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 787/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.624071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.633104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 805/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.633104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.634589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c8d9-1621-4336-bdf8-54ebfb20f0fb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.639606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.640236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.640436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daf3b9-d2f1-4c21-ad82-f52e34e2ace2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.640561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.640784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.641410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.643931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.645447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.646022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.646303 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.646576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.647232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.648810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.651209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.661741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 806/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.662526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.672538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69760-f0d5-460b-8b51-a0b2bd32e46b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.673077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 788/1594] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.673983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.686997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.731834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.732448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.732730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.733004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.733642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.735513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350225a-647d-411e-9cb7-cd4254e60cf9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.736126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1725-3475-434c-88bb-b59a2b8696a0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.740759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.741301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.741597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.741850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.742491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.744102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.745238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 807/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.746412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.746694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.746991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.756816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 789/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.757781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.769505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90426-eaef-425c-a517-1da8b34639fa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.774012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.774547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] MFA Rules not processed for user `1d16fbf8fa384566809e9e2c5150c598`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:21.774655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.774850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.775158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.775782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.775903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:21.777362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.787770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 790/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.788560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.797699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5fe9-29b3-4f11-a900-69ef4338ffd9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.802272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.802846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.803158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.803434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.804055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.805628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.815787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 791/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.816569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.825825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651277a-8493-4d5d-8a79-af1073976ce2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.830643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.831769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.832073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.832341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.832955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.834602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.843699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 808/1599] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:21.848370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 792/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:21.848370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.848566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.855328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e89eb-6dea-49c4-b0e4-00a08836e05a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.858933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef845eb-649d-4fd1-82d1-264308619dca None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.860301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.860894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.861175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.861448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.862077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.864087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.864489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.865206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.865408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.865671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] PATH_INFO: `/v3/projects/77d9ce126e3f42ea9580c466bb3f157b/users/7d1043d005964a12a7fcf3d4226293c5/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.882003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d9ce126e3f42ea9580c466bb3f157b, user_id=7d1043d005964a12a7fcf3d4226293c5, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.883135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:21.883135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:13:21.883135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:13:21.885089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.887193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 793/1601] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:21 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:21.888113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.898950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a002d7-7802-4602-857f-caf1f9c75e6d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.902587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 809/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:21 2022] PUT /identity/v3/projects/77d9ce126e3f42ea9580c466bb3f157b/users/7d1043d005964a12a7fcf3d4226293c5/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:21.903461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.957332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.957994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.958273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.958543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] PATH_INFO: `/v3/projects/90e0457f773f4097a8256b2bc1b530ee/users/94374f8729b1437a8cd0e171d94faf00/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.972460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350394-c63b-4ade-8ee5-6870bb40d516 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:21.973101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e0457f773f4097a8256b2bc1b530ee, user_id=94374f8729b1437a8cd0e171d94faf00, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.975755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:21.977080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:21.977731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:21.978042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:21.978282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] PATH_INFO: `/v3/projects/c115b5aecf4e4cd9a62043c8c5883c0a/users/44aee5cd548b4973a79bb6e254bbd0f4/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:21.980628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:21.989140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 794/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:21 2022] PUT /identity/v3/projects/90e0457f773f4097a8256b2bc1b530ee/users/94374f8729b1437a8cd0e171d94faf00/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:21.990171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:21.996626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c115b5aecf4e4cd9a62043c8c5883c0a, user_id=44aee5cd548b4973a79bb6e254bbd0f4, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:21.999404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.014090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 810/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:21 2022] PUT /identity/v3/projects/c115b5aecf4e4cd9a62043c8c5883c0a/users/44aee5cd548b4973a79bb6e254bbd0f4/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:22.014886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.039496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:22.057735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c760ff-32f8-4bf4-9586-987e8a4477bf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.079491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845292c-8486-42fc-ab94-9bbc2787ed9d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.084811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.085472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.085752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.086025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] PATH_INFO: `/v3/projects/fc9f516c579b403ba77df96bbca5cf4c/users/c12b9e26465e42ad8b41f0347074a1a9/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.100193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9f516c579b403ba77df96bbca5cf4c, user_id=c12b9e26465e42ad8b41f0347074a1a9, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.102864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.115778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.116452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.116766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.117038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] PATH_INFO: `/v3/projects/5d797b04427641cc9724086af85f788a/users/0a427a204a4c4086bda58acbffbe2dea/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.122338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 811/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:22 2022] PUT /identity/v3/projects/fc9f516c579b403ba77df96bbca5cf4c/users/c12b9e26465e42ad8b41f0347074a1a9/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:22.122338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.136539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d797b04427641cc9724086af85f788a, user_id=0a427a204a4c4086bda58acbffbe2dea, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.139355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.155012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 795/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:21 2022] PUT /identity/v3/projects/5d797b04427641cc9724086af85f788a/users/0a427a204a4c4086bda58acbffbe2dea/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:22.155951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.190848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be42cf-91b5-4d44-bac1-67c9fb482975 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.220927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09697e1d-4c8c-4fb1-8319-2528bab2dff3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.225659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.226318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.226597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.226871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] PATH_INFO: `/v3/projects/43b8b0a2263e411d9aae0224e5faad26/users/cdd373c9c605411192219100d5c58689/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.242281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b8b0a2263e411d9aae0224e5faad26, user_id=cdd373c9c605411192219100d5c58689, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.245155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.246719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.247318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.247617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.247871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.248539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.250583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907802-4d6a-44e8-8aac-8e74081c5114 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.258527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 796/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:22 2022] PUT /identity/v3/projects/43b8b0a2263e411d9aae0224e5faad26/users/cdd373c9c605411192219100d5c58689/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:22.259426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.281290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:22.289625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 812/1608] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/projects => generated 357 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:22.291584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3fd3-024d-481f-ab9b-6870952d590b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.291584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3fd3-024d-481f-ab9b-6870952d590b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.291584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3fd3-024d-481f-ab9b-6870952d590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.319858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:22.320540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-48cb3fd3-024d-481f-ab9b-6870952d590b None None] MFA Rules not processed for user `7d1043d005964a12a7fcf3d4226293c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.321915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-48cb3fd3-024d-481f-ab9b-6870952d590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.324990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d05e-f996-4ac9-92b1-d34f93d6301f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.382307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.382912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.383219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.383491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.384126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.385791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eca762-4304-4581-8fb8-094fb32d1ef9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.390199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 813/1609] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.391461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c89-19b3-40ad-8c33-aab13deb4886 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.391767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c89-19b3-40ad-8c33-aab13deb4886 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.392016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c89-19b3-40ad-8c33-aab13deb4886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.396478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 797/1610] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:22.397570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfed76-010b-4b12-8268-ac88088b09f7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.397934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfed76-010b-4b12-8268-ac88088b09f7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.398210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfed76-010b-4b12-8268-ac88088b09f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.413947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-01390c89-19b3-40ad-8c33-aab13deb4886 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.415198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-01390c89-19b3-40ad-8c33-aab13deb4886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.416623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-67dfed76-010b-4b12-8268-ac88088b09f7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.417726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67dfed76-010b-4b12-8268-ac88088b09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.422762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 814/1611] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.423996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8f879-4e39-4c5f-8626-7340a21cf696 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.424277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8f879-4e39-4c5f-8626-7340a21cf696 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.425093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8f879-4e39-4c5f-8626-7340a21cf696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.428782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 798/1612] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.428782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.428782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.428782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.447782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-edf8f879-4e39-4c5f-8626-7340a21cf696 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.448977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-edf8f879-4e39-4c5f-8626-7340a21cf696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.456582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] MFA Rules not processed for user `0a427a204a4c4086bda58acbffbe2dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.457936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.459175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 815/1613] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.460872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.461315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.461712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.493876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] MFA Rules not processed for user `cdd373c9c605411192219100d5c58689`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:22.495101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.533254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 799/1614] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.537159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.545270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a12d1-f36d-4d55-8901-e138c5bafba8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.550226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.550810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.551117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.551418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.552497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.554417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.561613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 816/1615] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:22.562476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.580143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143f4e-77ec-4bcd-acac-ccd104f65a55 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.583581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 800/1616] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:22.583581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.587234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.587907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.588195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.588494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] PATH_INFO: `/v3/projects/ba7b9eaf35224225b79cc14722483405/users/4d8acbe0944e4eddb0c3c8f0868755c6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.607231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7b9eaf35224225b79cc14722483405, user_id=4d8acbe0944e4eddb0c3c8f0868755c6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.610945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.626297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 817/1617] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:22 2022] PUT /identity/v3/projects/ba7b9eaf35224225b79cc14722483405/users/4d8acbe0944e4eddb0c3c8f0868755c6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:22.626297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.626297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:22.643998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab5abd-37ad-4140-bd3e-fbcb99fb1bf0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.660256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:22.673749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:22.690660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcd542-146d-42ed-af8b-c7d387c23ae7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.694326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.694675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.694927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.695233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.695351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.695505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.695609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.695977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.751207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.752694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.755546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.756969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.761619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 801/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:22.762410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.767702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 818/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:22.771456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10d82-1287-4ec2-a098-259c461d03da service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.775570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.776273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.776643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.776874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.777263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.788307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274037-55f6-443b-bd64-2d6c816a6831 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.790528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.792236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.793024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.793816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.794249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.794655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.804866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 802/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:22.805543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.807358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.810026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.815617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbd4c-9e3f-427d-9042-4bf776664f9f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.822063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.822692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.822977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.823287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.823931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.826495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ceb49-06c4-4ec9-afe6-b1510423c75e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.840956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 819/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:22.841698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.865146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be73775-dd54-4f8c-baa6-d8ba2bfae2f7 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.872599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 803/1622] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:22.874069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401945b-aca1-486b-816c-a7abc0c37358 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.874395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401945b-aca1-486b-816c-a7abc0c37358 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.875002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401945b-aca1-486b-816c-a7abc0c37358 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.876794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 804/1623] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 12 14:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:22.877649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401945b-aca1-486b-816c-a7abc0c37358 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.884910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.885539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.885811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.886057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.886701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.888325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.918571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 820/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:22.919648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:22.938754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b01df-b9b3-4c7f-9891-ac009187b5aa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.959694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401945b-aca1-486b-816c-a7abc0c37358 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:22.966520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:22.967501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.967793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.968076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:22.968794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:22.970507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a3d2b-9d3a-434e-96cc-06758fa84d12 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:22.985456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 805/1625] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:22.987959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:22.988270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:22.988691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.042168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:23.044273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:23.071318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:23.071531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.072037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.072225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.072495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.073130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.075406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.113793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 821/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:23.114668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.151072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e2963-7f9b-4c25-a5b9-d39c77cda6f9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.153434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 806/1627] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 12 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:23.154495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.163973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.164804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.165088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.165366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] PATH_INFO: `/v3/projects/abb8822da6e94614bc3a9ffc92679007/users/d919e287a0aa4e138e59070d6f544f5a/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.166768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb85eb-0731-4230-9cfa-eac90bae3636 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.189055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.189774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.193498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.193816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] PATH_INFO: `/v3/projects/ba7b9eaf35224225b79cc14722483405/users/4d8acbe0944e4eddb0c3c8f0868755c6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.198666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb8822da6e94614bc3a9ffc92679007, user_id=d919e287a0aa4e138e59070d6f544f5a, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.200746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7b9eaf35224225b79cc14722483405, user_id=4d8acbe0944e4eddb0c3c8f0868755c6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.202414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.207779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.228823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 822/1628] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:23 2022] PUT /identity/v3/projects/abb8822da6e94614bc3a9ffc92679007/users/d919e287a0aa4e138e59070d6f544f5a/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:23.230777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.259329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 807/1629] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:23 2022] PUT /identity/v3/projects/ba7b9eaf35224225b79cc14722483405/users/4d8acbe0944e4eddb0c3c8f0868755c6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:23.259329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.344343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:23.402141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a430-7167-4466-847f-a6c885e07fe5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.443156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2c6b-662c-49f3-b428-c3a111ea8872 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.452993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.454498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.454878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.456289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.506525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.507388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.507645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.507922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.508583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.510574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.526534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 823/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:23.527466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.547397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999e94e-aa1b-43af-af67-1bb433a5cb0e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.554755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.555412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.555746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.556079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.556740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.558733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415cad4-0a7a-4d59-abee-a2fa3b32550d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.566991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.569816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.578024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 824/1631] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:23.582657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.582950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.583316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.629734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 808/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:23.630906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.688918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfad3d-b89e-49ac-8aa4-3ff580bf827b service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.702835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.704012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.704475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.704912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] PATH_INFO: `/v3/projects/566dd526174e4ddbb533afbc353c48d4/users/d3f0b9e5c3574da4b31567d527507901/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.725099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] MFA Rules not processed for user `4d8acbe0944e4eddb0c3c8f0868755c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:23.728566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:23.749794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566dd526174e4ddbb533afbc353c48d4, user_id=d3f0b9e5c3574da4b31567d527507901, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.754948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.786041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 809/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:23 2022] PUT /identity/v3/projects/566dd526174e4ddbb533afbc353c48d4/users/d3f0b9e5c3574da4b31567d527507901/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:23.790430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.812136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:23.848982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 825/1634] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:23.850067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.865681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903c57e-d5dc-487f-98a1-f9a25b22f187 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.906657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0418d3-6e75-4e72-951d-d939b28c3348 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:23.913368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.914098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.914376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.914991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] PATH_INFO: `/v3/projects/abb8822da6e94614bc3a9ffc92679007/users/d919e287a0aa4e138e59070d6f544f5a/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.917148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb8822da6e94614bc3a9ffc92679007, user_id=d919e287a0aa4e138e59070d6f544f5a, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.920004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.931238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:23.944509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 810/1635] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:23 2022] PUT /identity/v3/projects/abb8822da6e94614bc3a9ffc92679007/users/d919e287a0aa4e138e59070d6f544f5a/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:23.946038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:23.964387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:23.966131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.966413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.967236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:23.968064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:23.969844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaaef0-3baf-4b27-898f-953596ce9cdf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:23.981901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 826/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:23.987766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:23.988048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:23.988320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.023437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] MFA Rules not processed for user `d919e287a0aa4e138e59070d6f544f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:24.023679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013716-e967-4d49-b73d-0e6f48b889d3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:24.024662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:24.028025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:24.029417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.029719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.029992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.135929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 827/1637] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:24.136855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:24.184492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:24.185983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b56c-42cd-4acc-9da9-5869d0f09c0a service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:24.198980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 811/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:24.200344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf52-b640-4d29-b216-bc391d53cc56 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.200935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf52-b640-4d29-b216-bc391d53cc56 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.201292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf52-b640-4d29-b216-bc391d53cc56 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.203266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 812/1639] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 12 14:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:24.204016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cf52-b640-4d29-b216-bc391d53cc56 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:24.219300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cf52-b640-4d29-b216-bc391d53cc56 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:24.227669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:24.228301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.228588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.229164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.244076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:24.246426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5825e7-8377-472b-add2-ffc7d05c79fc service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:24.260780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b0e33-7a49-47c9-8a10-d5f951ceefa3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:24.265293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 813/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:24.266882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.267297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.267664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.277895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:24.283657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.284474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.284752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] PATH_INFO: `/v3/projects/566dd526174e4ddbb533afbc353c48d4/users/d3f0b9e5c3574da4b31567d527507901/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.293000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566dd526174e4ddbb533afbc353c48d4, user_id=d3f0b9e5c3574da4b31567d527507901, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:24.302236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82493fe6-a331-451d-8e11-f0774140e386 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:24.309987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:24.313658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:24.343787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 828/1641] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:24 2022] PUT /identity/v3/projects/566dd526174e4ddbb533afbc353c48d4/users/d3f0b9e5c3574da4b31567d527507901/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:24.348067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.349108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.350420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.433961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:24.440588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] MFA Rules not processed for user `d3f0b9e5c3574da4b31567d527507901`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:24.442315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:24.492108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 814/1642] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:24.492987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:24.525202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f6b1a-462e-4fd8-a8e1-64eb48e7b537 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:24.555174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:24.597510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 829/1643] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:24.598754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:24.619411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:24.621214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.621937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.622610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.683805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f333b-5fc7-419c-9556-de64824d54f7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:24.697821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:24.698964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:24.700509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:24.700802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:24.731804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:24.733284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:24.752128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 815/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:24.801353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:24.803349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:24.838353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 830/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:25.032377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:25.045011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c78ac-d100-46ac-af28-94ef255c9a6b service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:25.051825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:25.052691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:25.052836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:25.053111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:25.220643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:25.230944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19cd15-e407-4324-8e8c-395fba621079 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:25.238140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:25.240060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:25.240742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:25.241075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:25.241534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:25.243481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10382ed-38dc-4b29-89e0-6d2d8be94d2b service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:25.264774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:25.269148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d38cc-5588-4abb-8bf5-5b93226d0fa4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:25.277808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 816/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:13:25.306648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 831/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:13:26.118291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab41b-5325-430c-b710-716389e3573d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:26.118859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab41b-5325-430c-b710-716389e3573d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:26.119394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab41b-5325-430c-b710-716389e3573d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:26.121558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 817/1648] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 12 14:13:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:26.130527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba851-2b30-47ec-89b4-0409c790d8f2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:26.130915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba851-2b30-47ec-89b4-0409c790d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:26.131332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba851-2b30-47ec-89b4-0409c790d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:26.186032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c12ba851-2b30-47ec-89b4-0409c790d8f2 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:26.188810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c12ba851-2b30-47ec-89b4-0409c790d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:26.230329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 832/1649] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 12 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:26.235872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675428-dd20-43cc-90e1-ac437d780fa4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:26.236280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675428-dd20-43cc-90e1-ac437d780fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:26.236659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675428-dd20-43cc-90e1-ac437d780fa4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:26.238502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 818/1650] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 12 14:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:26.245502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:26.245944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:26.246366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:26.280783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:26.282504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:26.295375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 833/1651] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:26.637349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675428-dd20-43cc-90e1-ac437d780fa4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:26.651488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675428-dd20-43cc-90e1-ac437d780fa4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:26.658773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:26.660573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:26.661425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:26.663154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:26.703313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:26.709206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e807b-9e20-4c91-8aa2-f992ea5ff0f5 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:26.734504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 819/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:28.131745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:28.254198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26293d9-17f7-445e-86bd-b3007ae35760 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:28.260626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:28.261487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:28.261910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:28.262350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] PATH_INFO: `/v3/users/0a427a204a4c4086bda58acbffbe2dea` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:28.264141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a427a204a4c4086bda58acbffbe2dea)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:28.265507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:28.265507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: warnings.warn(msg) Sep 12 14:13:28.265507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: Sep 12 14:13:28.267560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:28.347084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:28.416291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a427a204a4c4086bda58acbffbe2dea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:28.433827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a427a204a4c4086bda58acbffbe2dea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:28.435187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a427a204a4c4086bda58acbffbe2dea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:28.436218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a427a204a4c4086bda58acbffbe2dea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:28.493279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a427a204a4c4086bda58acbffbe2dea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:28.554775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 834/1653] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:28 2022] DELETE /identity/v3/users/0a427a204a4c4086bda58acbffbe2dea => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:28.559466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:28.559973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:28.560065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:28.567159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:28.615728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:28.616970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:28.846058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 820/1654] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:28.869383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:28.872183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:29.085562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fe45-a431-438c-849d-59ad2d11613b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:29.094439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:29.101150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:29.102697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:29.103205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:29.148634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:29.151067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:29.196705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 835/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:30.048453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:30.054214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:30.152356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be1ff-a393-4c2b-bdc5-8493fac374c7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:30.177200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:30.178092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:30.178589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:30.179110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] PATH_INFO: `/v3/projects/5d797b04427641cc9724086af85f788a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:30.187526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d797b04427641cc9724086af85f788a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:30.188930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 14:13:30.188930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 12 14:13:30.188930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: Sep 12 14:13:30.196483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:30.318942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d797b04427641cc9724086af85f788a', 'request_id': 'req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.341510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d797b04427641cc9724086af85f788a', 'request_id': 'req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.356513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d797b04427641cc9724086af85f788a', 'request_id': 'req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.419169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] The token cache is being invalidate because project 5d797b04427641cc9724086af85f788a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:30.419169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.426856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.432870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 821/1656] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:30 2022] DELETE /identity/v3/projects/5d797b04427641cc9724086af85f788a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:30.433044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:30.452914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c9533-d714-405f-b6d8-2407d8ed63fa service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:30.656594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:30.657772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:30.658238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:30.658783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] PATH_INFO: `/v3/users/d3f0b9e5c3574da4b31567d527507901` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:30.661652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f0b9e5c3574da4b31567d527507901)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:30.675403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:30.838945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:30.864472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f0b9e5c3574da4b31567d527507901'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.889057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f0b9e5c3574da4b31567d527507901'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.889878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f0b9e5c3574da4b31567d527507901'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.890856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f0b9e5c3574da4b31567d527507901'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.938617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fffc03d6-4c08-42b5-ab62-fbbff852c817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f0b9e5c3574da4b31567d527507901'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:30.993058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 836/1657] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:30 2022] DELETE /identity/v3/users/d3f0b9e5c3574da4b31567d527507901 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:32.271337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:32.273447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:32.307908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5f79-1de1-4643-b1c6-4f5673d204ec admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:32.475527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:32.476493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:32.476963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:32.477447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] PATH_INFO: `/v3/users/cdd373c9c605411192219100d5c58689` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:32.480461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd373c9c605411192219100d5c58689)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:32.482632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:32.566541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:32.607428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd373c9c605411192219100d5c58689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:32.622361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd373c9c605411192219100d5c58689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:32.622990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd373c9c605411192219100d5c58689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:32.623639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd373c9c605411192219100d5c58689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:32.645389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd373c9c605411192219100d5c58689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:32.682419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 822/1658] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:32 2022] DELETE /identity/v3/users/cdd373c9c605411192219100d5c58689 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:32.688842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:32.690310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:32.691116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:32.729606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:32.732679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:32.941288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 837/1659] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:32.953313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:32.955003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:33.125435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddac0-4cc7-4764-8524-1f1819fb9b5c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:33.137549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:33.138197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:33.138481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:33.138759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:33.178117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:33.179660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943e471-8abc-48b4-94b6-102f32401525 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:33.225369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 823/1660] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:34.003431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:34.005167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:34.030251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3bdb4-0667-4fa4-9ebc-e24064813cc7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:34.050741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:34.052191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.054171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.054706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] PATH_INFO: `/v3/projects/566dd526174e4ddbb533afbc353c48d4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.057909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] RBAC: Authorizing `identity:delete_project(project_id=566dd526174e4ddbb533afbc353c48d4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:34.065522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:34.206951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566dd526174e4ddbb533afbc353c48d4', 'request_id': 'req-d2b0dc04-d625-491f-af54-4ad5db4a063f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:34.221137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566dd526174e4ddbb533afbc353c48d4', 'request_id': 'req-d2b0dc04-d625-491f-af54-4ad5db4a063f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:34.255548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566dd526174e4ddbb533afbc353c48d4', 'request_id': 'req-d2b0dc04-d625-491f-af54-4ad5db4a063f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:34.287947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] The token cache is being invalidate because project 566dd526174e4ddbb533afbc353c48d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:34.290078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:34.293062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2b0dc04-d625-491f-af54-4ad5db4a063f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:34.301129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 838/1661] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:34 2022] DELETE /identity/v3/projects/566dd526174e4ddbb533afbc353c48d4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:34.302908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.303411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.303690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.364283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:34.365915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:34.572475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 824/1662] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:34.575263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.575723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.576170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.606752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:34.608375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:34.628183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 839/1663] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:34.633035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:34.646711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e568e-ef23-4f70-8e62-27ac3da766be None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:34.665343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:34.666562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.666852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.667530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.669869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:34.670133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:34.674708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:34.717535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 825/1664] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:34.720370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:34.734057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d223-db60-4d0e-abc6-73ba43cd53d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:34.748370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:34.749388 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.749865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.750357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.751239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:34.753416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247fafb-9f8f-4fc7-8efa-2800391702ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:34.820613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 840/1665] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:34.821618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:34.838336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1cb3-ebb3-44c5-8f66-2b2d7d42693f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:34.917962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:34.943420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.943903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.944389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.987069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:34.987701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:34.988149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:34.990083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:34.991378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:34.992061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:34.994540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] MFA Rules not processed for user `c12b9e26465e42ad8b41f0347074a1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:34.996269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:35.002576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:35.039554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 826/1666] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:34 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:35.043980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:35.069903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b288a-f32c-4ea3-976a-46628eac22d5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:35.077247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:35.079748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.079846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.085056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.085779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:35.090276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:35.134351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 827/1667] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:35.135339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:35.184099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2aa71-d350-4070-a2b9-d213d25ae9ce admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:35.191905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 841/1668] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:35.196134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:35.198478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:35.202758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:35.206132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.206435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.206727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.207429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:35.218869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee089df6-06eb-4b34-a1b8-2e4bb0e36200 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:35.242802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec088-6c9f-4c33-996f-7e2b39614056 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:35.253106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:35.253769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.256131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.256718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] PATH_INFO: `/v3/projects/43b8b0a2263e411d9aae0224e5faad26` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.257918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b8b0a2263e411d9aae0224e5faad26)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:35.259920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:35.260583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 828/1669] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:35.262022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.270758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.270758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.336214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] MFA Rules not processed for user `c12b9e26465e42ad8b41f0347074a1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:35.337771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:35.369350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 829/1670] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:35.369350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:35.388497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b8b0a2263e411d9aae0224e5faad26', 'request_id': 'req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:35.404211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b8b0a2263e411d9aae0224e5faad26', 'request_id': 'req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:35.404471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62aa6e-f239-4360-93ad-d731abec09d2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:35.430703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b8b0a2263e411d9aae0224e5faad26', 'request_id': 'req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:35.473409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] The token cache is being invalidate because project 43b8b0a2263e411d9aae0224e5faad26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:35.473786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:35.475502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:35.483331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 842/1671] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:35 2022] DELETE /identity/v3/projects/43b8b0a2263e411d9aae0224e5faad26 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:35.485110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:35.488483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:35.612850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:35.614407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.615053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.615573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] PATH_INFO: `/v3/projects/6d8a1019cf464d7eab0e88194760bc2b/users/b3c8b7cd403e41ff98c6e8dac9412650/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.645304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8a1019cf464d7eab0e88194760bc2b, user_id=b3c8b7cd403e41ff98c6e8dac9412650, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:35.648710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3f6b2-c596-4ddf-a480-cd9119ba3124 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:35.684540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 830/1672] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:35 2022] PUT /identity/v3/projects/6d8a1019cf464d7eab0e88194760bc2b/users/b3c8b7cd403e41ff98c6e8dac9412650/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:35.688217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979be67-0966-4fec-8786-a9958d4aa2fa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.688511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979be67-0966-4fec-8786-a9958d4aa2fa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.688853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979be67-0966-4fec-8786-a9958d4aa2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:35.733112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1979be67-0966-4fec-8786-a9958d4aa2fa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:35.734604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1979be67-0966-4fec-8786-a9958d4aa2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:35.792386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df57e-8b03-4c1c-8cc6-8f2759f03186 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:35.857397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:35.958902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 831/1673] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:35.960212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:35.960502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:35.960789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.019553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.022634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.024302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.024824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.027444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:36.060882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] MFA Rules not processed for user `b3c8b7cd403e41ff98c6e8dac9412650`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:36.062234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:36.078920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:36.136154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.138364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f4e58-f728-4977-ad7c-17f5a7895c4c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.180341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 843/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:36.184065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.187607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.188801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.256704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 832/1675] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:36.262026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.266301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:36.289733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:36.290920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:36.305887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aeaf4-8bd9-421c-a40d-a674a9d61865 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.322034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 844/1676] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:36.324183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.326662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.330301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.330694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.331161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.332021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.334643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.351750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365537e-00cd-4982-9862-57542355ccd5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.366096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.367240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.367527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.367806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.368941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:36.369165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.370812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.388865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 833/1677] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:36 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:36.390774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.453330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 845/1678] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:36.457274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.509660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20537-5082-4316-a57e-f371283104bd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.539527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83959c7-228b-4954-b41e-d6685a020030 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.540386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.541041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.541306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.541582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.542238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.544272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.559744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.560583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.563581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.564573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.578747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.583601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.624087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 834/1679] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:36 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:36.627377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.653140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cdbf7-47e9-4b4b-b3a4-456a4a43b51f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.665059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.666220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.666600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.667020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.667804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.669821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.673111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 846/1680] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:36 2022] POST /identity/v3/projects => generated 403 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:36.677197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.704753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 835/1681] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:36.707004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:36.747007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4bd4-bc00-4aab-874f-9a1a32e7e530 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.886347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdc01-1e0e-4f82-a298-c5ddeaa91b54 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:36.914282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.916680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.917505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.918990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] PATH_INFO: `/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816/users/25bdc8ef346b417b9532f7f7095474da/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.921780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:36.922429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:36.922712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:36.923016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:36.925918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.934204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:36.959214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:36.967864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c2f251bf74ebeb3b1db5e2ebe8816, user_id=25bdc8ef346b417b9532f7f7095474da, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:36.977177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.004879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 836/1682] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:36 2022] PUT /identity/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816/users/25bdc8ef346b417b9532f7f7095474da/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:37.007368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.007520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 847/1683] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:36 2022] POST /identity/v3/users => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:13:37.008854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.033112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71be6-46e9-497a-9b99-a057a648b24d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.052297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:37.138779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fcfc3-7d2c-4c87-902b-4b1f0098b6f7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.164642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.165844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.166210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.167154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.168451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.171454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.187849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 837/1684] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:13:37.191633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.202314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.203401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.203947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.204363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.206197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.208159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563875c-ae4d-42ed-a3ad-af41f666ecfc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.208391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd8bf-ce2d-4f80-b085-70cf914f84fb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.241506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 848/1685] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:37.241946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.243270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41472905-c179-4f5b-bb40-c2f8b64cc3db None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.243559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41472905-c179-4f5b-bb40-c2f8b64cc3db None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.243832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41472905-c179-4f5b-bb40-c2f8b64cc3db None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.244171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.246014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.246291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.249057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.250509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 849/1686] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 12 14:13:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:37.251511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41472905-c179-4f5b-bb40-c2f8b64cc3db None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.255241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02cf43-5c95-4f36-8bae-ce72294963c5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.275743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 838/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:37.278036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.278371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.278857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.283479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41472905-c179-4f5b-bb40-c2f8b64cc3db None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.293784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.294466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.294746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.295017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] PATH_INFO: `/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816/users/25bdc8ef346b417b9532f7f7095474da/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.297541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c2f251bf74ebeb3b1db5e2ebe8816, user_id=25bdc8ef346b417b9532f7f7095474da, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.300685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.324541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 850/1688] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:37 2022] PUT /identity/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816/users/25bdc8ef346b417b9532f7f7095474da/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:37.325012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.336079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:37.338676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:37.341225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:37.460135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 839/1689] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:37.461211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:37.481225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7d5c-b882-4912-a82f-d2ae1ca349f5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.487967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8f25-d124-493f-a6be-b4a22c593bad None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:37.488909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.489686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.490041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.490553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] PATH_INFO: `/v3/users/7d1043d005964a12a7fcf3d4226293c5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.492505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1043d005964a12a7fcf3d4226293c5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.495550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.511252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:37.512030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.513460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.513816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] PATH_INFO: `/v3/projects/a82dcb2b297a490c97cdae8b95b3b050/users/fb35d5b716da469cabbeddf6174c2947/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.566710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82dcb2b297a490c97cdae8b95b3b050, user_id=fb35d5b716da469cabbeddf6174c2947, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:37.577252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66b6a4-3e34-4e5f-bf34-53b4bcddf095 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:37.620293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 840/1690] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:37 2022] PUT /identity/v3/projects/a82dcb2b297a490c97cdae8b95b3b050/users/fb35d5b716da469cabbeddf6174c2947/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:37.621849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.624535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.625393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.627920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1043d005964a12a7fcf3d4226293c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:37.645644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1043d005964a12a7fcf3d4226293c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:37.648472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1043d005964a12a7fcf3d4226293c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:37.650343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1043d005964a12a7fcf3d4226293c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:37.677523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ed8232-3603-46aa-9363-a86b665c5945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1043d005964a12a7fcf3d4226293c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:37.722913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 851/1691] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:37 2022] DELETE /identity/v3/users/7d1043d005964a12a7fcf3d4226293c5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:37.726569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178c64-ca5a-4c33-9c3c-e5edd60667aa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:37.727052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] MFA Rules not processed for user `25bdc8ef346b417b9532f7f7095474da`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:37.727496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178c64-ca5a-4c33-9c3c-e5edd60667aa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:37.728357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:37.729378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178c64-ca5a-4c33-9c3c-e5edd60667aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:37.775181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:37.807709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-be178c64-ca5a-4c33-9c3c-e5edd60667aa None None] MFA Rules not processed for user `44aee5cd548b4973a79bb6e254bbd0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:37.809374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-be178c64-ca5a-4c33-9c3c-e5edd60667aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:37.859857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:37.998878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 841/1692] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:37.998878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.000823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.042032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 852/1693] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:38.045481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.047332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.047771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.127632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] MFA Rules not processed for user `fb35d5b716da469cabbeddf6174c2947`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:38.128686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2a29d-e5c5-40b9-8b7d-0b4be1f80457 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.129327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.133853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.134953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.135422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.135978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.140655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.164293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.165767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34dd97-ec1c-4f64-b916-b90882eb092c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:38.185608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 842/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:38.186890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.187779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.188021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.231674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 853/1695] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:38.232793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.233918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:38.234983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.235408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.388597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8d4b0-ff6e-4b42-a1cd-ecdbb1f42e62 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.403663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.404065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.404346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.404641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.405594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 843/1696] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:38.406598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.412352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.417461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.535756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:38.577689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae93e-03e1-4dbe-835e-c003b70cb9dd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.582263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.585745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:38.596257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903333-f973-425f-8691-737591bfa125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.597805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903333-f973-425f-8691-737591bfa125 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.599366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903333-f973-425f-8691-737591bfa125 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.600076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903333-f973-425f-8691-737591bfa125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.610539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 854/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:38.611463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.617176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.650758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df903333-f973-425f-8691-737591bfa125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.652432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df903333-f973-425f-8691-737591bfa125 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:38.668163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:38.670204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762358b5-e48c-419c-a831-2e36a6209a8d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.685774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.687822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.688374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.688661 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.689921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.693311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:38.698724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 844/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:38.699736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903333-f973-425f-8691-737591bfa125 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.705026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-df903333-f973-425f-8691-737591bfa125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:38.751493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903333-f973-425f-8691-737591bfa125 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.763914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 855/1699] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:38 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:38.768711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:38.781866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.782513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.782790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.783115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.824072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.831560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:38.879391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 845/1700] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:38.955611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121824-2ab8-4170-9c62-50ced9a45d55 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:38.974934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:38.976609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:38.976905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:38.979358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:38.981842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:38.992701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba8f3-7f81-4baa-805a-581d7aecae09 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:39.057299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 856/1701] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:38 2022] POST /identity/v3/users => generated 308 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:39.059961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.070727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dae24-5f9c-478c-8c55-a6f97bbd034d service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:39.124719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae29a9-6c74-4b86-be5a-81ae9310dbe9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.125002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae29a9-6c74-4b86-be5a-81ae9310dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.125271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae29a9-6c74-4b86-be5a-81ae9310dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.134724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:39.135723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.136007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.136272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.137052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:39.138748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:39.184482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3dae29a9-6c74-4b86-be5a-81ae9310dbe9 None None] MFA Rules not processed for user `94374f8729b1437a8cd0e171d94faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:39.186886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3dae29a9-6c74-4b86-be5a-81ae9310dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:39.201765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 846/1702] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:39.202843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.243680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc952-2bb9-46b4-a50a-a1b3387ea6e4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:39.263991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:39.264671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.264953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.265222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] PATH_INFO: `/v3/projects/73c1f251b91844dcb5f45081bcf885a3/users/ea3366490e27470a925e09e02f51f0c6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.349636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1f251b91844dcb5f45081bcf885a3, user_id=ea3366490e27470a925e09e02f51f0c6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:39.358818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:39.389068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 847/1703] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:39 2022] PUT /identity/v3/projects/73c1f251b91844dcb5f45081bcf885a3/users/ea3366490e27470a925e09e02f51f0c6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:39.389968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.501523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 857/1704] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:39.515070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.515070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.515070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.568108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] MFA Rules not processed for user `94374f8729b1437a8cd0e171d94faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:39.569654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:39.590593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3636a-6882-45ce-bece-a219a9a872f8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:39.602402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:39.603496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.605242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.605657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.606512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:39.611262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:39.645276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 848/1705] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:39.646886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.651239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:39.718271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:39.765391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 858/1706] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:39.766664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.789674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d42c7-91c6-4e01-b7a0-70f32396ed0d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:39.815722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:39.820640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:39.822739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:39.824266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] PATH_INFO: `/v3/projects/73c1f251b91844dcb5f45081bcf885a3/users/ea3366490e27470a925e09e02f51f0c6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:39.832253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1f251b91844dcb5f45081bcf885a3, user_id=ea3366490e27470a925e09e02f51f0c6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:39.838379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:39.863715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 859/1707] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:39 2022] PUT /identity/v3/projects/73c1f251b91844dcb5f45081bcf885a3/users/ea3366490e27470a925e09e02f51f0c6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:39.865170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:39.869940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0bd9-67de-4a39-a370-72d35b7f0f7e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:39.871255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:39.972542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:40.012875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:40.013484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.013766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.014045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.016718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.038994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:40.040774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:40.047907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6667c-f517-4181-ae31-77d0da3fdf1f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:40.052257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 849/1708] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:40.062441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:40.065698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.067127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:40.067246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.067421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.070995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.231290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:40.232891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f0d1-1864-4193-b72d-cedb9ed49b1c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:40.247850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f6bc2-609c-4d20-9194-0db871e8c000 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:40.262881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 860/1709] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:40.264561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202ac9-3071-49c2-95ea-0e32fc02ff3d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.266560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202ac9-3071-49c2-95ea-0e32fc02ff3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.266867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202ac9-3071-49c2-95ea-0e32fc02ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.273261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:40.273929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.274210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.274555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] PATH_INFO: `/v3/projects/77d9ce126e3f42ea9580c466bb3f157b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.277102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d9ce126e3f42ea9580c466bb3f157b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:40.285717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:40.332739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0202ac9-3071-49c2-95ea-0e32fc02ff3d None None] MFA Rules not processed for user `ea3366490e27470a925e09e02f51f0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:40.334399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0202ac9-3071-49c2-95ea-0e32fc02ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.474184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d9ce126e3f42ea9580c466bb3f157b', 'request_id': 'req-10835558-1d57-40f3-8215-60a1cd6f63ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:40.496762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d9ce126e3f42ea9580c466bb3f157b', 'request_id': 'req-10835558-1d57-40f3-8215-60a1cd6f63ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:40.510675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:40.512030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d9ce126e3f42ea9580c466bb3f157b', 'request_id': 'req-10835558-1d57-40f3-8215-60a1cd6f63ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:40.536190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 861/1710] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:40.536342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] The token cache is being invalidate because project 77d9ce126e3f42ea9580c466bb3f157b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:40.536342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:40.536687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:40.547817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 850/1711] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:40 2022] DELETE /identity/v3/projects/77d9ce126e3f42ea9580c466bb3f157b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:40.549794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc090-bb6d-4321-ac92-2a8f7615cf9f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.550191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc090-bb6d-4321-ac92-2a8f7615cf9f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.550469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc090-bb6d-4321-ac92-2a8f7615cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.598560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-adefc090-bb6d-4321-ac92-2a8f7615cf9f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:40.599823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-adefc090-bb6d-4321-ac92-2a8f7615cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.651922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:40.654133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.811794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 862/1712] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:40.815693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.817160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.817491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.851475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:40.854009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.874035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 863/1713] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:40.875671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:40.890364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10983d4-ca61-4a9f-8e89-ae9284c1d104 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:40.909908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:40.911242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.911467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.911884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.912788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:40.913408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:40.916394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:40.921050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835558-1d57-40f3-8215-60a1cd6f63ce admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:40.932915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:40.933525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 864/1714] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:40.935180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:40.935843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:40.936323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:40.937879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:40.946839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:40.978560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9753400-2b51-4e43-9b9b-61e707122a85 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.019977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.020628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.020929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.021205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.022798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.024903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.065798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 865/1715] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:40 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:41.071115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.074910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:41.191568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7c9ce-d360-4eb2-826b-ec1345242c23 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.200048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.200734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.201265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.201549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.202340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.205812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.236198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 866/1716] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:41 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:41.240434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.246096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.250381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.255471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe898-8da0-4b5a-8e5d-035462a06615 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.262526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.263237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.263617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.263938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.264597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.268250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.285014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 867/1717] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:13:41.288670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.300290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36dee-8581-486a-a516-871855a15723 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.300816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 851/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:40 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:13:41.306751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.308415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.308897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.309240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.310147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.315833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ddbad-9497-40d6-9c14-f19c923a7df3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.332834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 868/1719] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:13:41.338355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.365172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb0c1-bccd-418c-8a44-21246af96c77 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.374325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.375365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.375851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.376307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] PATH_INFO: `/v3/projects/e79213f64d88444d91961c868567a846/users/14a34bdd09d44abea9e3b7cc1750c25e/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.408505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79213f64d88444d91961c868567a846, user_id=14a34bdd09d44abea9e3b7cc1750c25e, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.411804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.469900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 852/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:41 2022] PUT /identity/v3/projects/e79213f64d88444d91961c868567a846/users/14a34bdd09d44abea9e3b7cc1750c25e/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:41.471845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.472245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.473744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.588063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.590397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:41.609940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] MFA Rules not processed for user `14a34bdd09d44abea9e3b7cc1750c25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:41.615322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:41.658754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:41.795683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f132-3f06-4a5c-9bb7-02a63c0ff01b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.812235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.816234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.817359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.817830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] PATH_INFO: `/v3/users/fb35d5b716da469cabbeddf6174c2947` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.824074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb35d5b716da469cabbeddf6174c2947)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.830244 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:41.924718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 869/1721] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:41.926272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:41.953267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb35d5b716da469cabbeddf6174c2947'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:41.969595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb35d5b716da469cabbeddf6174c2947'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:41.972008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb35d5b716da469cabbeddf6174c2947'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:41.974901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb35d5b716da469cabbeddf6174c2947'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:41.982107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be781-2b42-43d5-bc7c-1e54d647b666 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:41.992697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:41.993325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:41.993605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:41.993877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:41.994520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:41.999231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:42.007197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ff2cfb17-fee9-4b66-9611-0809c5291e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb35d5b716da469cabbeddf6174c2947'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:42.048359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 853/1722] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:41 2022] DELETE /identity/v3/users/fb35d5b716da469cabbeddf6174c2947 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:42.053207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e1a-0f22-4d92-924e-2bd846990c9e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.053583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e1a-0f22-4d92-924e-2bd846990c9e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.053949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e1a-0f22-4d92-924e-2bd846990c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.075446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 870/1723] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:41 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:42.080554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:42.084538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.103266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5cfe9e1a-0f22-4d92-924e-2bd846990c9e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:42.104508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5cfe9e1a-0f22-4d92-924e-2bd846990c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.140481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:42.263658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 854/1724] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:42.266405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.268707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.269737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.339223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] MFA Rules not processed for user `94374f8729b1437a8cd0e171d94faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:42.342625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.357278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdf526-77c7-4a3b-b4cd-b4af0f09746a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:42.380988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:42.381684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.382003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.382281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.385139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:42.393124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:42.477176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 871/1725] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:42 2022] POST /identity/v3/users => generated 297 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:42.483158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:42.492162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.534581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 855/1726] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:42.535546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:42.572711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.655770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cf454-aa2a-46dd-b66f-a0ec4f1d2b1e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:42.675663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:42.676343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.679375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.679711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.716491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:42.718336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:42.746882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 872/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:42.752723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769439-726f-4e7a-9742-f492ccc725f1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:42.768888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:42.769688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:42.773901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.774204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.774633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.784116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:42.794605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f21-d72d-46e6-a5b6-ddc830e9c89c service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:42.806634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:42.809414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.809944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.810231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.810920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:42.814894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:42.847344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 873/1728] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:42.850916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:42.871647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a2b4-e351-4b9e-85a3-9d21fc5b1bb5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:42.890482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:42.894199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:42.894738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:42.895141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] PATH_INFO: `/v3/projects/fc78633ed3a44459be3ec19e851f92df/users/163b9afe09ab4bf18841886ea346b152/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:42.910568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:42.922675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc78633ed3a44459be3ec19e851f92df, user_id=163b9afe09ab4bf18841886ea346b152, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:42.935227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:42.968848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 874/1729] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:42 2022] PUT /identity/v3/projects/fc78633ed3a44459be3ec19e851f92df/users/163b9afe09ab4bf18841886ea346b152/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:42.970523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:43.071702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:43.082239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:43.114322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 856/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:43.131395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab905-c740-4ae6-ad7c-32855dd0efc2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:43.145184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:43.146596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:43.148239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:43.148557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:43.150446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:43.156294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638633bd-60f5-41c6-92e6-863fd2a1c2e3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:43.191714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 875/1731] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:43.192969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:43.211936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d9731-83d1-4126-afe2-9d3872b368f7 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:43.230996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:43.231766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:43.232109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:43.236522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] PATH_INFO: `/v3/projects/fc78633ed3a44459be3ec19e851f92df/users/163b9afe09ab4bf18841886ea346b152/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:43.244425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc78633ed3a44459be3ec19e851f92df, user_id=163b9afe09ab4bf18841886ea346b152, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:43.251445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:43.285554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:43.305727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 857/1732] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:43 2022] PUT /identity/v3/projects/fc78633ed3a44459be3ec19e851f92df/users/163b9afe09ab4bf18841886ea346b152/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:43.317528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:43.317877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:43.318198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:43.401964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] MFA Rules not processed for user `163b9afe09ab4bf18841886ea346b152`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:43.403622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:43.547703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:43.550350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:43.754878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 876/1733] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:43.810330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1798d-f747-47e9-b59f-30ab0fe51c04 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:43.838566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:43.839330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:43.839612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:43.840468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] PATH_INFO: `/v3/projects/a82dcb2b297a490c97cdae8b95b3b050` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:43.842917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82dcb2b297a490c97cdae8b95b3b050)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:43.853687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:43.899463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:43.901238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:44.004561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82dcb2b297a490c97cdae8b95b3b050', 'request_id': 'req-852a48c1-42a6-4c1c-b91b-e95fcfdac571'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.037619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82dcb2b297a490c97cdae8b95b3b050', 'request_id': 'req-852a48c1-42a6-4c1c-b91b-e95fcfdac571'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.055736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82dcb2b297a490c97cdae8b95b3b050', 'request_id': 'req-852a48c1-42a6-4c1c-b91b-e95fcfdac571'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.081092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] The token cache is being invalidate because project a82dcb2b297a490c97cdae8b95b3b050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:44.081092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.082499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.088039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 858/1734] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:43 2022] DELETE /identity/v3/projects/a82dcb2b297a490c97cdae8b95b3b050 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:44.089386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:44.092058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:44.152764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbb18b-72cd-4b0d-93da-9d6495150758 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:44.213088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:44.299599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:44.300298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.300585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.300858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.310278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:44.402189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a48c1-42a6-4c1c-b91b-e95fcfdac571 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:44.424562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:44.425340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.425631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.425906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] PATH_INFO: `/v3/users/ea3366490e27470a925e09e02f51f0c6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.430148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3366490e27470a925e09e02f51f0c6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:44.434479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:44.498383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:44.499784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d5936-06b1-45b2-905c-5c085a7d1f61 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:44.530751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 877/1735] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:44.531724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376dd4-e20d-4310-8fe8-3dc205a9840a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.532019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376dd4-e20d-4310-8fe8-3dc205a9840a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.532297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376dd4-e20d-4310-8fe8-3dc205a9840a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.544338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 878/1736] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 12 14:13:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:13:44.551724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e6d-a360-4018-9635-d54b9c2f72d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.551883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e6d-a360-4018-9635-d54b9c2f72d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.552163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e6d-a360-4018-9635-d54b9c2f72d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.572771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:44.624637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3366490e27470a925e09e02f51f0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.637162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ec442e6d-a360-4018-9635-d54b9c2f72d5 None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:44.638386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec442e6d-a360-4018-9635-d54b9c2f72d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:44.655578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3366490e27470a925e09e02f51f0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.668752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3366490e27470a925e09e02f51f0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.670683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3366490e27470a925e09e02f51f0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.708410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cf10819c-e944-4349-914e-c76e472374ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3366490e27470a925e09e02f51f0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:44.790437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 859/1737] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:44 2022] DELETE /identity/v3/users/ea3366490e27470a925e09e02f51f0c6 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:44.802945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.803454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.803965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.813333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 879/1738] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:44.820950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:44.821244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:44.821521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:44.889126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] MFA Rules not processed for user `44aee5cd548b4973a79bb6e254bbd0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:44.893145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:45.000667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:45.003517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:45.116523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 860/1739] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:45.116523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:45.118501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:45.222631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:45.263818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 880/1740] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:45.308586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae112fc-151f-488e-ab2b-3053850c7860 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:45.318870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:45.326661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:45.326941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:45.327235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:45.364161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:45.369380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:45.410786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 861/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:45.614098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:45.615837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:45.635957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:45.637696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:45.926906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:45.942389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc62bc3-61b9-4e2f-852e-6324abdbd6b9 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:45.955764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:45.957615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:45.959349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:45.960017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] PATH_INFO: `/v3/projects/73c1f251b91844dcb5f45081bcf885a3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:45.962439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c1f251b91844dcb5f45081bcf885a3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:45.966485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:46.028924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9c26-25bc-4b35-b744-d2f3bbd7ad36 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:46.046617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:46.048471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.048804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.049017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.077043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:46.088801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:46.095789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c1f251b91844dcb5f45081bcf885a3', 'request_id': 'req-8f17989c-9716-4b06-8e3a-dc1280f8dfca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:46.113390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 881/1742] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:13:46.123664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:46.125354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:46.132634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c1f251b91844dcb5f45081bcf885a3', 'request_id': 'req-8f17989c-9716-4b06-8e3a-dc1280f8dfca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:46.162593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c1f251b91844dcb5f45081bcf885a3', 'request_id': 'req-8f17989c-9716-4b06-8e3a-dc1280f8dfca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:46.178147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] The token cache is being invalidate because project 73c1f251b91844dcb5f45081bcf885a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:46.178413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:46.181180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f17989c-9716-4b06-8e3a-dc1280f8dfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:46.202845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 862/1743] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:45 2022] DELETE /identity/v3/projects/73c1f251b91844dcb5f45081bcf885a3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:46.212061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3c10-5054-4028-b120-88c19b933fb3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.212504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3c10-5054-4028-b120-88c19b933fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.213221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3c10-5054-4028-b120-88c19b933fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.294610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a16f3c10-5054-4028-b120-88c19b933fb3 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:46.295916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a16f3c10-5054-4028-b120-88c19b933fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:46.335623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b62ad-e39c-4805-b643-ba8c56fe7e48 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:46.508811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163b9afe09ab4bf18841886ea346b152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc78633ed3a44459be3ec19e851f92df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:46.509478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.509755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.510034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.511902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:46.512217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:46.522175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:46.574647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 882/1744] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:46.589684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:46.591687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 863/1745] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:46.593183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:46.600120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.600466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.601015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.660557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f974-38db-48bc-ad9a-c048eefad9b6 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:46.681040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163b9afe09ab4bf18841886ea346b152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc78633ed3a44459be3ec19e851f92df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:46.681594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.681882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.682159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.682817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:46.687140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:46.692922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:46.697903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:46.725425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:46.736556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 864/1746] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:13:46.742515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:46.786621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a516ab-24a7-4789-bd04-06869d9aefc1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:46.816376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:46.817121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:46.817541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:46.818538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:46.819998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:46.820525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:46.822701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:46.832060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 883/1747] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:46 2022] POST /identity/v3/projects => generated 354 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:46.838473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:46.912932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 865/1748] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:46.933031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:47.015477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eaa-b6bb-4515-bb4d-f703cf82eb46 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:47.069188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055c26a-733f-4230-bb7b-c7778af17b90 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:47.097490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163b9afe09ab4bf18841886ea346b152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc78633ed3a44459be3ec19e851f92df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:47.098304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:47.125158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:47.125515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:47.132891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:47.133896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:47.141211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:47.240875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 884/1749] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:47.241888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:47.248354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:47.370971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:47.380568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:47.380839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:47.381120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:47.385607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:47.390747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:47.453648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:47.530378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 866/1750] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:47.537661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:47.607824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91852a-4586-47db-864c-b0e818232584 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:47.811495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e979ea-1af0-407e-9cd8-a7147be3c854 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:47.812481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:47.813315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:47.813854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:47.814327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] PATH_INFO: `/v3/users/1d16fbf8fa384566809e9e2c5150c598` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:47.816319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d16fbf8fa384566809e9e2c5150c598)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:47.825690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:47.843245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163b9afe09ab4bf18841886ea346b152', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc78633ed3a44459be3ec19e851f92df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:47.843920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:47.844205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:47.844488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] PATH_INFO: `/v3/projects/70851f2d5085447196015485d4d61039` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:47.848224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=70851f2d5085447196015485d4d61039)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:47.852893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:47.903672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:47.981676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d16fbf8fa384566809e9e2c5150c598'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.000612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70851f2d5085447196015485d4d61039', 'request_id': 'req-47cbd9e4-2059-4bb6-a9bc-f3f337131402'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.005555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d16fbf8fa384566809e9e2c5150c598'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.006154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d16fbf8fa384566809e9e2c5150c598'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.006843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d16fbf8fa384566809e9e2c5150c598'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.020252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70851f2d5085447196015485d4d61039', 'request_id': 'req-47cbd9e4-2059-4bb6-a9bc-f3f337131402'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.050060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70851f2d5085447196015485d4d61039', 'request_id': 'req-47cbd9e4-2059-4bb6-a9bc-f3f337131402'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.050695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85816d76-4efe-459a-bb89-736c5ebd4e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d16fbf8fa384566809e9e2c5150c598'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.076196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] The token cache is being invalidate because project 70851f2d5085447196015485d4d61039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:48.076563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.077248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:48.079115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 867/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:47 2022] DELETE /identity/v3/projects/70851f2d5085447196015485d4d61039 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:48.080642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.093671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:48.104591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 885/1752] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:47 2022] DELETE /identity/v3/users/1d16fbf8fa384566809e9e2c5150c598 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:48.117181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.117835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.118335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.188437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:48.193426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:48.269776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbd9e4-2059-4bb6-a9bc-f3f337131402 tempest-VolumeQuotaClassesTest-1832468762 tempest-VolumeQuotaClassesTest-1832468762-project-admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:48.336246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:48.424240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:48.425217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.425516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.425787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.426497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:48.442532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:48.476622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 886/1753] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:48.485328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.487519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:48.547808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 868/1754] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:48 2022] POST /identity/v3/users => generated 292 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:48.570530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.598886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8af3-9289-4fc3-82ab-29cad3a12671 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:48.617033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:48.627925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.628918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.629750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.631255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:48.633650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:48.675203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 869/1755] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:48.678560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.703044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b0bc-8e33-478a-8b75-e0d7b0a05132 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:48.716421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:48.717646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.718201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.718712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.721463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:48.724386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:48.739939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 870/1756] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:48.744794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.781335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18221dc6-ae0f-49d6-bf6f-0864f1d69a03 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:48.782084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f605-836f-48cc-b096-8c406be5dab4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:48.798383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:48.799706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:48.800798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.801153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.801441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] PATH_INFO: `/v3/projects/56029e93a0034b52baf4b71b21a20100/users/a2e058f894f3433987d1e097e15ba9ba/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.803024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.803348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.807910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.858513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:48.858513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:48.879935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56029e93a0034b52baf4b71b21a20100, user_id=a2e058f894f3433987d1e097e15ba9ba, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:48.883363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907413b-d80f-4dd2-95e8-c60b895eef7e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:48.941989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 887/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:48.941989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:48.941989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:48.942250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 871/1758] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:48 2022] PUT /identity/v3/projects/56029e93a0034b52baf4b71b21a20100/users/a2e058f894f3433987d1e097e15ba9ba/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:48.956164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:48.956753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:48.957037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:48.985444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070c54-7f31-4c07-9a2e-ef9c685ea908 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:49.088737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] MFA Rules not processed for user `a2e058f894f3433987d1e097e15ba9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:49.097816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:49.192229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:49.266874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:49.268102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:49.268364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:49.274704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] PATH_INFO: `/v3/users/14a34bdd09d44abea9e3b7cc1750c25e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:49.283534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a34bdd09d44abea9e3b7cc1750c25e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:49.290737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:49.380831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 872/1759] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:49.386756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:49.467612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a34bdd09d44abea9e3b7cc1750c25e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:49.489307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a34bdd09d44abea9e3b7cc1750c25e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:49.490175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967191e5-c9ea-440b-881e-d8c4bed9d279 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:49.492726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a34bdd09d44abea9e3b7cc1750c25e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:49.498434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a34bdd09d44abea9e3b7cc1750c25e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:49.539967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:49.540825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:49.541114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:49.541391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:49.542047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:49.549957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:49.565000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4620be95-24af-4171-acbc-543913b086bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a34bdd09d44abea9e3b7cc1750c25e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:49.653704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 888/1760] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:48 2022] DELETE /identity/v3/users/14a34bdd09d44abea9e3b7cc1750c25e => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:49.669571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:49.669896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:49.670177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:49.710834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 873/1761] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:49 2022] POST /identity/v3/projects => generated 381 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:49.718940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:49.732150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:49.801211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:49.812871 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:49.880970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:50.024164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778a29-c737-4d84-a2ab-640e4f96f66b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.041284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.041923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.042264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.042504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.043324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.046160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.097733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 874/1762] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:49 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:50.103058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:50.118304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b48b-31a9-4549-abb0-490183be56ff admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.138360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.146908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.146908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.146908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.150077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.152719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 889/1763] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:50.156496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.173235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 875/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:50.177433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:50.194766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30fd7b-6164-4117-9d64-727ab189e3ff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.201567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.202579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.203118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.203628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] PATH_INFO: `/v3/projects/397bde2f5ff443cf9a197a9bc54a0230/users/758b5fc479ea4c5eaac9094527692937/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.227447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:50.229247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:50.231633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397bde2f5ff443cf9a197a9bc54a0230, user_id=758b5fc479ea4c5eaac9094527692937, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.235779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.255853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73995f-7aca-4bd5-901b-8634806e59ca admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.274879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 890/1765] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:50 2022] PUT /identity/v3/projects/397bde2f5ff443cf9a197a9bc54a0230/users/758b5fc479ea4c5eaac9094527692937/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:50.277407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:50.281406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:50.489575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:50.537162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.537765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.537765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.538223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] PATH_INFO: `/v3/projects/305adb075c304b03b8036d634d5f80a3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.541188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=305adb075c304b03b8036d634d5f80a3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.543245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.567253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52688ae-2fd6-45e6-bb4e-a26e15e8a1f8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.579225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.579974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.580259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.580552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.664644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.667280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.696204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 891/1766] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:50.698618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:50.724610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7b9a-76f3-4405-a15f-d30e8535d862 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:50.822742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305adb075c304b03b8036d634d5f80a3', 'request_id': 'req-af4f037e-9e6d-4cdf-92ea-5dff963933c8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:50.859464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305adb075c304b03b8036d634d5f80a3', 'request_id': 'req-af4f037e-9e6d-4cdf-92ea-5dff963933c8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:50.905789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305adb075c304b03b8036d634d5f80a3', 'request_id': 'req-af4f037e-9e6d-4cdf-92ea-5dff963933c8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:50.977323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:50.977960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:50.978235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:50.978502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:50.979181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:50.980816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:50.986477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] The token cache is being invalidate because project 305adb075c304b03b8036d634d5f80a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:50.989484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:50.991394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-af4f037e-9e6d-4cdf-92ea-5dff963933c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.015020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 876/1767] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:50 2022] DELETE /identity/v3/projects/305adb075c304b03b8036d634d5f80a3 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:51.015020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:51.015020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:51.015020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:51.040020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 892/1768] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:51.051185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:51.056407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:51.073358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd13d0-7c73-4555-9ef3-4cf5cecf2b54 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:51.097823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:51.099393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:51.103178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:51.103645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] PATH_INFO: `/v3/users/d919e287a0aa4e138e59070d6f544f5a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:51.105615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d919e287a0aa4e138e59070d6f544f5a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:51.114029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:51.126766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:51.144693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:51.361341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd919e287a0aa4e138e59070d6f544f5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.391654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd919e287a0aa4e138e59070d6f544f5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.392619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd919e287a0aa4e138e59070d6f544f5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.393389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd919e287a0aa4e138e59070d6f544f5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.409674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:51.420447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ded34e2-c3f0-414f-aa0b-edde4533436e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd919e287a0aa4e138e59070d6f544f5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:51.439109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 877/1769] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 12 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:51.440349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:51.446985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:51.471443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 893/1770] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:51 2022] DELETE /identity/v3/users/d919e287a0aa4e138e59070d6f544f5a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:51.499615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccaf80-001a-474e-8814-ad87749090a2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:51.656178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:51.656949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:51.657173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:51.657473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] PATH_INFO: `/v3/projects/397bde2f5ff443cf9a197a9bc54a0230/users/758b5fc479ea4c5eaac9094527692937/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:51.660753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397bde2f5ff443cf9a197a9bc54a0230, user_id=758b5fc479ea4c5eaac9094527692937, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:51.663870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:51.704198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 878/1771] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:51 2022] PUT /identity/v3/projects/397bde2f5ff443cf9a197a9bc54a0230/users/758b5fc479ea4c5eaac9094527692937/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:51.716910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:51.717540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:51.717969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:51.744415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:51.746354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:51.845724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeef5d-81b5-451d-a19b-0f4c912f9e17 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:51.850050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] MFA Rules not processed for user `758b5fc479ea4c5eaac9094527692937`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:51.852036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:51.856034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:51.857197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:51.858195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:51.859825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:51.878392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:51.881718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:51.901705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 879/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:51.978869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:52.020858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 894/1773] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:52.046083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:52.048177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:52.222415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa344b-f8a3-4d8a-8b79-3ec2898b10fb service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:52.229565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:52.231352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:52.231650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:52.231958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:52.257161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:52.259489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:52.301698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 880/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:52.472415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:52.483971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc369d7-12d3-4853-a910-c4649638a06d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:52.490602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:52.491710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:52.492256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:52.492882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:52.496085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:52.653189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:52.654655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:52.687002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 895/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:53.174290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:53.176194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:53.269473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:53.327380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2793c-1d59-41b9-a46d-37b01a187ed4 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:53.339297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:53.339960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:53.340236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:53.340504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] PATH_INFO: `/v3/projects/e79213f64d88444d91961c868567a846` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:53.342999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79213f64d88444d91961c868567a846)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:53.346267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:53.485733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79213f64d88444d91961c868567a846', 'request_id': 'req-905f7a23-a75f-4be5-82ba-e872463d7ada'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.505999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79213f64d88444d91961c868567a846', 'request_id': 'req-905f7a23-a75f-4be5-82ba-e872463d7ada'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.533723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79213f64d88444d91961c868567a846', 'request_id': 'req-905f7a23-a75f-4be5-82ba-e872463d7ada'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.592378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] The token cache is being invalidate because project e79213f64d88444d91961c868567a846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:53.592997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.596785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.603145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 881/1776] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:53 2022] DELETE /identity/v3/projects/e79213f64d88444d91961c868567a846 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:53.607091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:53.664253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b756bf-c7c5-486e-8b8e-3ac75e6abc69 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:53.839264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:53.839928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:53.840205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:53.840477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] PATH_INFO: `/v3/users/163b9afe09ab4bf18841886ea346b152` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:53.841701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163b9afe09ab4bf18841886ea346b152)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:53.843824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:53.966166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163b9afe09ab4bf18841886ea346b152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.977936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163b9afe09ab4bf18841886ea346b152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.979718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163b9afe09ab4bf18841886ea346b152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:53.980654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163b9afe09ab4bf18841886ea346b152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.005587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33b21a-12b5-4e12-8fb6-bd8f825f7e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163b9afe09ab4bf18841886ea346b152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.017973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:54.024568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:54.026127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:54.029354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 896/1777] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:53 2022] DELETE /identity/v3/users/163b9afe09ab4bf18841886ea346b152 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:54.051697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7a23-a75f-4be5-82ba-e872463d7ada admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:54.223932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:54.225025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:54.225344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:54.227267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] PATH_INFO: `/v3/projects/abb8822da6e94614bc3a9ffc92679007` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:54.228631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb8822da6e94614bc3a9ffc92679007)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:54.232153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:54.363286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb8822da6e94614bc3a9ffc92679007', 'request_id': 'req-95ae1d44-cb25-44dd-af12-79606c7b7316'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.405199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb8822da6e94614bc3a9ffc92679007', 'request_id': 'req-95ae1d44-cb25-44dd-af12-79606c7b7316'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.412834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb8822da6e94614bc3a9ffc92679007', 'request_id': 'req-95ae1d44-cb25-44dd-af12-79606c7b7316'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.422575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:54.429865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] The token cache is being invalidate because project abb8822da6e94614bc3a9ffc92679007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:54.430812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.432146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-95ae1d44-cb25-44dd-af12-79606c7b7316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:54.438101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 882/1778] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:54 2022] DELETE /identity/v3/projects/abb8822da6e94614bc3a9ffc92679007 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:54.443705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:54.444777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:54.445243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:54.473582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:54.475052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:54.736734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 897/1779] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:54.744618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:54.745119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:54.745506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:54.848638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:54.861108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:54.934486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 883/1780] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:54.934789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:54.953576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc4c2-bc55-4cf1-8903-bae78392d6c7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:54.974020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:54.975287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:54.975838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:54.976325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:54.977225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:54.981493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:54.984328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.020637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 898/1781] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:55.022577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:55.044574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f32aca-b872-4992-bd61-d1b144e90b6a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:55.065970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:55.071434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.072400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.072733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.073400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:55.088451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.183780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 884/1782] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:55 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:13:55.193421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:55.232222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494eea-da8c-4242-a2f9-74919a9e1b4e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:55.464138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:55.465456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.465911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.466311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.467365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:55.471525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.513850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:55.514462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 899/1783] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:55 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:55.541283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebae578-2f5a-4a2c-9196-70e92cb33499 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:55.562613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:55.568384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.571863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.572941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.577602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:55.584064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.624910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 885/1784] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:13:55.626656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:55.644449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675935-2c40-4279-b4d0-50f4850cc68f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:55.652801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:55.653807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.654425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.655004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.657508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:55.661607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6101178-281b-4d26-8c66-aef4e1c2daf8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.692731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 900/1785] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:55.693872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:55.709473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b8388-2cef-4485-96e7-26ea6dfcb718 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:55.721530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:55.722642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.722992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.723470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] PATH_INFO: `/v3/projects/d570fc428b814a69803c3132e126cfc0/users/84813c7197c34783a9893e58332537b4/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.754435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d570fc428b814a69803c3132e126cfc0, user_id=84813c7197c34783a9893e58332537b4, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:55.757249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:55.802675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 886/1786] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:55 2022] PUT /identity/v3/projects/d570fc428b814a69803c3132e126cfc0/users/84813c7197c34783a9893e58332537b4/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:55.812865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:55.814173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:55.814173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:55.880587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] MFA Rules not processed for user `84813c7197c34783a9893e58332537b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:55.883722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:56.028263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:56.056706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 901/1787] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:56.058170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:56.209801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6ecd-d76b-4cd0-8b1b-1bf28dcee2d1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:56.235977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:56.236747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.237438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.237438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:56.237941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:56.240019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf51379-d357-47ee-a96f-294321272cfd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:56.295440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 887/1788] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:56 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:56.296918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:56.313310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529bddf-2e70-43a2-9dbc-9275899bf9fe None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:56.408453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.408961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.409378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:56.411315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 888/1789] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:13:56.412385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:56.414394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:56.472976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:56.473666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.473882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.476788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:56.479257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:56.481238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda01645-c2e6-4203-9da3-4b600b238d12 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:56.593504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 902/1790] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:56 2022] POST /identity/v3/users => generated 300 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:56.603787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb7c4-4e54-4190-a701-705e03bbab22 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.604484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123f7cb-21c4-43fd-ae96-0c1ee784c593 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:56.606970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb7c4-4e54-4190-a701-705e03bbab22 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.607371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb7c4-4e54-4190-a701-705e03bbab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:56.612996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:56.613708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.613993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.614348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] PATH_INFO: `/v3/users/a2e058f894f3433987d1e097e15ba9ba` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:56.615802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e058f894f3433987d1e097e15ba9ba)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:56.618277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:56.703121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef9eb7c4-4e54-4190-a701-705e03bbab22 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:56.728771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef9eb7c4-4e54-4190-a701-705e03bbab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:56.737604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:56.806497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e058f894f3433987d1e097e15ba9ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:56.818065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e058f894f3433987d1e097e15ba9ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:56.819443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e058f894f3433987d1e097e15ba9ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:56.820331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e058f894f3433987d1e097e15ba9ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:56.839457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e058f894f3433987d1e097e15ba9ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:56.887024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 889/1791] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:56 2022] DELETE /identity/v3/users/a2e058f894f3433987d1e097e15ba9ba => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:56.888144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:56.892765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:56.941839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 903/1792] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:56.945674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:56.946758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:56.947055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.003126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:57.012077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:57.064707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018462c-5116-48f1-bc6f-8d4186a08580 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.071947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.072801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.073085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.073360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.074433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.077942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.096354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 890/1793] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:57.115065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.184373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d41088-9346-477a-8ef6-01b0a61515f9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.198933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 904/1794] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:57.203697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.204543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.204828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.205106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] PATH_INFO: `/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee/users/bb2f1f5ead6f43a58ede31d2a12ca529/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.205217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.215366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:57.239860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cbd9efb1154ac9bc5b43283f8286ee, user_id=bb2f1f5ead6f43a58ede31d2a12ca529, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.253932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.262689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:57.281214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 891/1795] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:57 2022] PUT /identity/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee/users/bb2f1f5ead6f43a58ede31d2a12ca529/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:57.284906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.293266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:57.397648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113afa-54fd-4379-af9d-feb58218676d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.492504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffbc5a-cb96-4601-a74a-7cf737b5da96 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.500096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.501214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.501857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.502372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.578425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:57.629769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.630614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.633636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.634225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.681433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.682988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.714182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 905/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:57.715713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.718457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:57.719107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.724198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.755409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 892/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:57.756261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.768301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226df01-76a6-438e-a613-102357545dc3 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.785407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.786073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.786354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.786629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] PATH_INFO: `/v3/projects/fc78633ed3a44459be3ec19e851f92df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.794293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc78633ed3a44459be3ec19e851f92df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.797099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.802053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69477d6f-9eab-4bd9-b324-0882a435798f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.832451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.833044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.833324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.833715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.836955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.836955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.873215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 893/1798] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:57.877542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:57.916931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3264b-986e-40fa-a316-4999214f60c8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:57.943463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:57.943463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:57.943855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:57.944293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] PATH_INFO: `/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee/users/bb2f1f5ead6f43a58ede31d2a12ca529/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:57.946791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cbd9efb1154ac9bc5b43283f8286ee, user_id=bb2f1f5ead6f43a58ede31d2a12ca529, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:57.950278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9df33-f1dc-449d-8949-42680094a7fc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:57.979321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 894/1799] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:57 2022] PUT /identity/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee/users/bb2f1f5ead6f43a58ede31d2a12ca529/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:57.999533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc78633ed3a44459be3ec19e851f92df', 'request_id': 'req-1d887374-3b55-46b5-9091-23f93456d181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.001311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.002523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.002945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.009759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc78633ed3a44459be3ec19e851f92df', 'request_id': 'req-1d887374-3b55-46b5-9091-23f93456d181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.045877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc78633ed3a44459be3ec19e851f92df', 'request_id': 'req-1d887374-3b55-46b5-9091-23f93456d181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.069642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] The token cache is being invalidate because project fc78633ed3a44459be3ec19e851f92df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:13:58.070037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.070853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d887374-3b55-46b5-9091-23f93456d181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.074264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 906/1800] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:57 2022] DELETE /identity/v3/projects/fc78633ed3a44459be3ec19e851f92df => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:58.083530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1228-9356-4108-85ab-e317c795143a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.085379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1228-9356-4108-85ab-e317c795143a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.087101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1228-9356-4108-85ab-e317c795143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.153642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] MFA Rules not processed for user `bb2f1f5ead6f43a58ede31d2a12ca529`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:58.161241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:58.181760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cfab1228-9356-4108-85ab-e317c795143a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:58.189717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cfab1228-9356-4108-85ab-e317c795143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:58.267652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:58.410745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 907/1801] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:58.416023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.416023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.416023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.427447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 895/1802] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:58.486527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:58.498512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:58.508985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:58.510965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:58.526851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 908/1803] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:58.528047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:58.550911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c408f-d150-4ab0-a923-d38e96f73b30 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:58.573789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:58.574883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.575225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.575613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.576292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:13:58.576605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:58.578400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:58.622021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 909/1804] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:13:58.627425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:58.641526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb281fe-6124-48d3-918b-73bd9d825e74 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:58.650567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:58.651685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.652185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.652793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.674635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91e0d6-f377-40cc-aa36-60ef79a6bfcd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:58.675696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:58.677670 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:58.693045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:58.693916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.694335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.694620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.695810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:58.697923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:58.699199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 896/1805] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:13:58.767914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:58.770355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:58.788221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca91041-31ae-44b5-8b9c-a5ce8d0dadb4 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:58.806436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:58.807271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:58.807601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:58.808347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] PATH_INFO: `/v3/users/84813c7197c34783a9893e58332537b4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:58.814583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84813c7197c34783a9893e58332537b4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:58.817250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:58.839209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 910/1806] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:58 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:13:58.841409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:58.873138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:58.959555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84813c7197c34783a9893e58332537b4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.979765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84813c7197c34783a9893e58332537b4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.980149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84813c7197c34783a9893e58332537b4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:58.981044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84813c7197c34783a9893e58332537b4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:59.010391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3567295c-aa8e-4797-acce-02221ce616e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84813c7197c34783a9893e58332537b4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:59.044912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e85ab-9de5-4f71-9234-d2252a2de460 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.062614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.065360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.065650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.065929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.066594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.073494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 897/1807] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:13:58 2022] DELETE /identity/v3/users/84813c7197c34783a9893e58332537b4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:13:59.078014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.078276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.078562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.089129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.129287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:59.130533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:59.177741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 911/1808] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:13:58 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:13:59.182454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.186434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:59.226718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8311-3016-4cb2-a458-94d89b5978b1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.291903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 898/1809] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:59.335860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.337493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:59.399988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.400775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.401151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.401859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.406434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.411282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.440920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 912/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:59.447220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.475698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fe26-ba20-4948-bf10-311e858a3511 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.494757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdccc4-e22f-4144-a462-829286095e66 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.501738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.502947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.503392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.503882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.504562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.505285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.505569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.505905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.516823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.518633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f81df1-23be-4f8d-9288-71f4100c068f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.519285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.521016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.524961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:59.550763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 899/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:13:59.568237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 913/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:13:59.572186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.601607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b6f1-cc80-4940-b9c1-fe769b57d35f service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.607570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.608756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.609502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.610064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] PATH_INFO: `/v3/projects/c865b425641d402aae4a065659df939e/users/d0f914e5dd974acab5de89dbe21764ad/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.642839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c865b425641d402aae4a065659df939e, user_id=d0f914e5dd974acab5de89dbe21764ad, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.647306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.673365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 900/1813] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:13:59 2022] PUT /identity/v3/projects/c865b425641d402aae4a065659df939e/users/d0f914e5dd974acab5de89dbe21764ad/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:13:59.688732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.688732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.688732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.696435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.700103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:59.750343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] MFA Rules not processed for user `d0f914e5dd974acab5de89dbe21764ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:13:59.752359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:13:59.753916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:59.853598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717aec-31c5-47cb-9d02-547e79bd09da admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.862782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:13:59.863867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:13:59.864231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:13:59.864604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] PATH_INFO: `/v3/projects/56029e93a0034b52baf4b71b21a20100` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:13:59.866240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56029e93a0034b52baf4b71b21a20100)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:13:59.870833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:13:59.924231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 914/1814] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:13:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:13:59.925950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:13:59.953342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56029e93a0034b52baf4b71b21a20100', 'request_id': 'req-24fdd78e-8c41-4446-ad17-c640d75f60b8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:59.956618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef619b23-cd52-4f52-857a-c36ee8af2e7e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:13:59.967241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56029e93a0034b52baf4b71b21a20100', 'request_id': 'req-24fdd78e-8c41-4446-ad17-c640d75f60b8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:13:59.981766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56029e93a0034b52baf4b71b21a20100', 'request_id': 'req-24fdd78e-8c41-4446-ad17-c640d75f60b8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.033003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] The token cache is being invalidate because project 56029e93a0034b52baf4b71b21a20100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:00.033003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.062711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.077958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 901/1815] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:13:59 2022] DELETE /identity/v3/projects/56029e93a0034b52baf4b71b21a20100 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:00.086472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.091558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.092637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.093852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.095267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:00.095726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.098424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.102952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.158584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 915/1816] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:13:59 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:00.162719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.165539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd78e-8c41-4446-ad17-c640d75f60b8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.167518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:00.288082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229651f5-16eb-4d04-a92c-c3ed49a5562d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.294309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.294309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.309222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.309606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] PATH_INFO: `/v3/users/758b5fc479ea4c5eaac9094527692937` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.317698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=758b5fc479ea4c5eaac9094527692937)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.329803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.332391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.346079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.346079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.346079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.346079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.346079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.397057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:00.418965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 916/1817] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:00 2022] POST /identity/v3/users => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:00.422485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.461375 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15467-8a91-4053-8e0d-b4f4552bf2c2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.473594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.474758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.475093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.475683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.476503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.479055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.480842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758b5fc479ea4c5eaac9094527692937'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.486014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:00.498613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758b5fc479ea4c5eaac9094527692937'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.500105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758b5fc479ea4c5eaac9094527692937'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.501055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758b5fc479ea4c5eaac9094527692937'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.512357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 917/1818] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:00.514456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.517052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758b5fc479ea4c5eaac9094527692937'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:00.522655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:00.539126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31db44-00c9-4203-b9b5-5b06084ae41e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.545870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.549446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 902/1819] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:00 2022] DELETE /identity/v3/users/758b5fc479ea4c5eaac9094527692937 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:00.549567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.549567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.549567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] PATH_INFO: `/v3/projects/03a182a511f946c984eabe339852ab48/users/ac498dd87c564242b5f78cab204f87cd/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.573919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a182a511f946c984eabe339852ab48, user_id=ac498dd87c564242b5f78cab204f87cd, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.578641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3296b-5c72-4fa8-9611-d96add2148a1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.609873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 918/1820] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:00 2022] PUT /identity/v3/projects/03a182a511f946c984eabe339852ab48/users/ac498dd87c564242b5f78cab204f87cd/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:00.611755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.633036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd389-6e4a-4538-8542-ef71c9d701ca None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.633325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd389-6e4a-4538-8542-ef71c9d701ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.633603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd389-6e4a-4538-8542-ef71c9d701ca None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.635384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 919/1821] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:14:00.694064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.694064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.694482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.726026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024ee7-497f-4dcc-b72f-baa3f201a0ef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.738760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:00.741072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:00.836469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.837106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.837474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.838157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.839444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.841360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ece4b5-808d-43ec-91b3-fe6fb2db39fc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.866599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 920/1822] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:14:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:00.876020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 903/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:00.878161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.892709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5559c5-1757-4d61-b37d-3bffb463b4fc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:00.899631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:00.900933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.901888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.902377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] PATH_INFO: `/v3/projects/03a182a511f946c984eabe339852ab48/users/ac498dd87c564242b5f78cab204f87cd/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.906410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a182a511f946c984eabe339852ab48, user_id=ac498dd87c564242b5f78cab204f87cd, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:00.911148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:00.929569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 921/1824] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:00 2022] PUT /identity/v3/projects/03a182a511f946c984eabe339852ab48/users/ac498dd87c564242b5f78cab204f87cd/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:00.949016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:00.949016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:00.949016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:00.949259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:00.950441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.011557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] MFA Rules not processed for user `ac498dd87c564242b5f78cab204f87cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:01.015418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.077492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993caa1-ac92-4de0-8cf5-27b1c913afb5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.089996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.091009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.091323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.092389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.103737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.107177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.128165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 922/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:01.151772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:01.174766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 904/1826] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:01.181182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.183695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.228223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:01.275071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca8a9-533f-49d4-9fd5-086c24bc197b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.281069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.281790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.283351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.283465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.283647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.283918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.296231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.298834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.320531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 923/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:01.333381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.335192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.416799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b74bf2-93fb-4935-bdf7-1f3db33d443f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.422812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.423701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.424074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.427542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] PATH_INFO: `/v3/projects/d570fc428b814a69803c3132e126cfc0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.430961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d570fc428b814a69803c3132e126cfc0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.433031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.438334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70151b-74fd-42a2-8a35-4a9f62d953a2 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.444106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.444346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.444629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.444899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] PATH_INFO: `/v3/projects/397bde2f5ff443cf9a197a9bc54a0230` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.446029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=397bde2f5ff443cf9a197a9bc54a0230)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.447986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.490696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd570fc428b814a69803c3132e126cfc0', 'request_id': 'req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.498923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd570fc428b814a69803c3132e126cfc0', 'request_id': 'req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.505276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397bde2f5ff443cf9a197a9bc54a0230', 'request_id': 'req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.509291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd570fc428b814a69803c3132e126cfc0', 'request_id': 'req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.512325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397bde2f5ff443cf9a197a9bc54a0230', 'request_id': 'req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.521617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397bde2f5ff443cf9a197a9bc54a0230', 'request_id': 'req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.522881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] The token cache is being invalidate because project d570fc428b814a69803c3132e126cfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:01.523212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.524591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.526292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 905/1828] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:01 2022] DELETE /identity/v3/projects/d570fc428b814a69803c3132e126cfc0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:01.527305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.530352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.533579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] The token cache is being invalidate because project 397bde2f5ff443cf9a197a9bc54a0230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:01.533824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.534473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.536121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 924/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:01 2022] DELETE /identity/v3/projects/397bde2f5ff443cf9a197a9bc54a0230 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:01.540130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.541451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.596599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0579fa-96a6-4075-a25b-7ecc0d8e6503 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.613805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f389c-ab2b-4623-a2ce-d5c4a70a8c1c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.619364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.620016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.620296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.620577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] PATH_INFO: `/v3/users/bb2f1f5ead6f43a58ede31d2a12ca529` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.622144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2f1f5ead6f43a58ede31d2a12ca529)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.624429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.627612 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:01.650940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:01.667187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.667187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.667187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.667187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.667801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.689813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2f1f5ead6f43a58ede31d2a12ca529'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.699659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2f1f5ead6f43a58ede31d2a12ca529'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.700281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2f1f5ead6f43a58ede31d2a12ca529'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.701036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2f1f5ead6f43a58ede31d2a12ca529'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.715310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f95312f1-3c86-4d6a-b839-85870e9fc9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2f1f5ead6f43a58ede31d2a12ca529'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:01.729124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 925/1830] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:01 2022] DELETE /identity/v3/users/bb2f1f5ead6f43a58ede31d2a12ca529 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:01.730111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4d5e-4545-4c62-95ba-51cb4d57a43a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.730546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4d5e-4545-4c62-95ba-51cb4d57a43a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.730830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4d5e-4545-4c62-95ba-51cb4d57a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.758392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2b9b4d5e-4545-4c62-95ba-51cb4d57a43a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:01.760288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2b9b4d5e-4545-4c62-95ba-51cb4d57a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.765652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.767975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.796555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 906/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:01.796555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.796555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.805042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f289f62-e251-4839-b520-ada018f4e885 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.874179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 926/1832] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:01.881701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.882791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.882791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.882981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] PATH_INFO: `/v3/users/b3c8b7cd403e41ff98c6e8dac9412650` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.883101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.883718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.883718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.884691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c8b7cd403e41ff98c6e8dac9412650)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.886620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.909843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:01.911233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:01.921133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 927/1833] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:01.926390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.939366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096d463-e9f2-47e1-89bc-753654623b4b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:01.948164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:01.948883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:01.949227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:01.949582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:01.952415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:01.952928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:01.956805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:01.973633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 928/1834] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:01.988493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:01.990348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c8b7cd403e41ff98c6e8dac9412650'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.007694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c8b7cd403e41ff98c6e8dac9412650'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.009545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c8b7cd403e41ff98c6e8dac9412650'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.010618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c8b7cd403e41ff98c6e8dac9412650'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.019233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0fc6-19a0-4b85-90b9-6ba9b989b5ee admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.027376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3e2452ed-3557-4d0f-a591-dfa139f3e2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c8b7cd403e41ff98c6e8dac9412650'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.031132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.031905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.032479 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.032851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.033980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.038750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.090098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 907/1835] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:01 2022] DELETE /identity/v3/users/b3c8b7cd403e41ff98c6e8dac9412650 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:02.092128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.094730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.098136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.120790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 929/1836] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:01 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:02.123858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.127277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.139937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:02.141472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.162423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:02.194322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:02.229364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393cf2-d609-4a87-8dd4-395a3369a3c1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.238010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.239186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.239663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.240174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.240974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.249375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 908/1837] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:02.260539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.262382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.262958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.326231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fba57-597b-454b-b44c-a6cc62408fcf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.331641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.331641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.331989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.332333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.342786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.344359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.347234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 930/1838] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:02.349407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.352645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.355822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 909/1839] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:02.356661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.371990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8832da7-c850-4bd7-86c8-f283ebad8218 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.379484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.380351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.380690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.380971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.381188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791dd5-8398-4250-8def-ec1bd475444a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.381811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.383594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.395072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.395713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.395971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.396265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] PATH_INFO: `/v3/users/d0f914e5dd974acab5de89dbe21764ad` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.396922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 910/1840] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:02.397940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.398717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f914e5dd974acab5de89dbe21764ad)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.402190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.408074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.429491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc551-3a69-42ec-bb47-f01934d008ac admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.436011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.436800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.437338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.437859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] PATH_INFO: `/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.439554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cbd9efb1154ac9bc5b43283f8286ee)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.442201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.494553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f914e5dd974acab5de89dbe21764ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.510402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f914e5dd974acab5de89dbe21764ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.511095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f914e5dd974acab5de89dbe21764ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.511775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f914e5dd974acab5de89dbe21764ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.518869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cbd9efb1154ac9bc5b43283f8286ee', 'request_id': 'req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.526622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f914e5dd974acab5de89dbe21764ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.529671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cbd9efb1154ac9bc5b43283f8286ee', 'request_id': 'req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.538537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cbd9efb1154ac9bc5b43283f8286ee', 'request_id': 'req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.543286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 931/1841] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:02 2022] DELETE /identity/v3/users/d0f914e5dd974acab5de89dbe21764ad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:02.544176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.545875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.553240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] The token cache is being invalidate because project 12cbd9efb1154ac9bc5b43283f8286ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:02.553451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.554182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57bdfd78-3b8d-4cba-8ce7-d08f35106daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.556008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 911/1842] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:02 2022] DELETE /identity/v3/projects/12cbd9efb1154ac9bc5b43283f8286ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:02.560752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.561044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.561323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.583708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:02.584964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.615636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:02.632201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312dc4-d95e-4546-bacd-e8716eea76ae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.637461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.638238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.638614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.638953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.639709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.642043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1b818-ba22-4a68-b68f-224e7fd31b5f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.652297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 932/1843] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:02.653688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.653965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.654312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.665412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 912/1844] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:02.666847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.672288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.676672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:02.678177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.686068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 933/1845] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:02.686219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe961d8-f8cd-47da-a237-1a698ac5af58 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.686775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.688052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.696275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.697083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.697363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.697639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] PATH_INFO: `/v3/projects/9ee9f86ea404476e95138cca1634d5db/users/e12ea38766be4cda94b7bf414f777c98/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.720072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee9f86ea404476e95138cca1634d5db, user_id=e12ea38766be4cda94b7bf414f777c98, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.723734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb01eac-f645-480e-8ea8-cba1ce4e8e8c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.740884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:02.750087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 913/1846] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:02 2022] PUT /identity/v3/projects/9ee9f86ea404476e95138cca1634d5db/users/e12ea38766be4cda94b7bf414f777c98/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:02.757091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.757525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.759473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.781769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e0dc-25dd-4ee2-a7e4-2de4fb3f461e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.783614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:02.784810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.836680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.837514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.837860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.838203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.871049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 914/1847] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:02.874982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:02.877117 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:02.897398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994052-146d-47b2-9c49-7df7c23bf5f9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:02.909317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:02.909989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.910273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.910617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] PATH_INFO: `/v3/projects/6d8a1019cf464d7eab0e88194760bc2b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.911883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8a1019cf464d7eab0e88194760bc2b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.914370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.937133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:02.939135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287e7e5-bde8-41d2-af73-c043e71fa595 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:02.953330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 934/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:02.955782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:02.956073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:02.956352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:02.983824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8a1019cf464d7eab0e88194760bc2b', 'request_id': 'req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:02.997633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8a1019cf464d7eab0e88194760bc2b', 'request_id': 'req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.011123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] MFA Rules not processed for user `e12ea38766be4cda94b7bf414f777c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:03.012371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.013663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8a1019cf464d7eab0e88194760bc2b', 'request_id': 'req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.055145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] The token cache is being invalidate because project 6d8a1019cf464d7eab0e88194760bc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:03.056632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.059690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.064829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 915/1849] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:02 2022] DELETE /identity/v3/projects/6d8a1019cf464d7eab0e88194760bc2b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:03.065981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.068350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.129335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:03.161969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 935/1850] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:03.162446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.170362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.184445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07f78-7efc-421c-8a4b-9f341aaa0bcf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.192457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.194584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.195686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.197309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.198050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:03.200451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afca20-b7ee-4193-84bc-7893361d88f8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.200605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.202412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.210609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.213540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.213826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.214107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] PATH_INFO: `/v3/users/25bdc8ef346b417b9532f7f7095474da` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.218457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bdc8ef346b417b9532f7f7095474da)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.222605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.231428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 916/1851] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:03.233218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.238555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.257259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1233712-72b0-4549-8a6b-3210101e18e7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.264243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.264908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.265187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.265460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.266160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.269742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.314588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:03.322555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 917/1852] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:03 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:03.323712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.395926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bdc8ef346b417b9532f7f7095474da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.418163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bdc8ef346b417b9532f7f7095474da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.419069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bdc8ef346b417b9532f7f7095474da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.419917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bdc8ef346b417b9532f7f7095474da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.458917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bdc8ef346b417b9532f7f7095474da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.478671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ff46-6025-4d54-ad18-c69cc7fc1bd2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.485861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.487118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.487118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.487498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.491091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 936/1853] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:03 2022] DELETE /identity/v3/users/25bdc8ef346b417b9532f7f7095474da => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:03.491245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.491245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.491406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.492626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.533469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 918/1854] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:03 2022] POST /identity/v3/projects => generated 407 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:03.533469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.534559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.590946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92acd-2fb9-4149-84d7-d9ba0d1a3186 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.626737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7e44-0b1d-445d-a484-c191e212ec08 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.657936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.658976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.659677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.661346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] PATH_INFO: `/v3/users/7253dfa754824c58a9b2a3ad13e61267` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.663281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7253dfa754824c58a9b2a3ad13e61267)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.665224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.699826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.699826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.699826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.699826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.700742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.706205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.735696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:03.758498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 937/1855] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:03 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:03.759456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.761135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.780872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd786ed-4f12-4ebf-8df1-884957055732 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.782578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7253dfa754824c58a9b2a3ad13e61267'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.786045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.787247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.787846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.788286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.789173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.791979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.794524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7253dfa754824c58a9b2a3ad13e61267'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.795568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7253dfa754824c58a9b2a3ad13e61267'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.797201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7253dfa754824c58a9b2a3ad13e61267'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.810701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7253dfa754824c58a9b2a3ad13e61267'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:03.827599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 938/1856] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:03 2022] POST /identity/v3/users => generated 304 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:03.828589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.833454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.838426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 919/1857] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:03 2022] DELETE /identity/v3/users/7253dfa754824c58a9b2a3ad13e61267 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:03.838426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.838426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.854052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ece53-84b1-4716-93b0-fcf6e309c243 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.873881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=86,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:03.917620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a69eb-fcb0-427a-8750-003aee289755 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.923191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.923836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.924119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.924399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.925233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.927404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.937350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 920/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:03.939695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.942304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.942304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.942304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] PATH_INFO: `/v3/projects/c865b425641d402aae4a065659df939e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.942556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:03.943167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:03.943990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c865b425641d402aae4a065659df939e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.946559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.956508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358094bc-25ec-4908-857a-fcd6890e3747 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:03.964228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:03.965031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.965415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.965765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:03.966492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:03.968155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d9ae-ccd8-4cab-ba0b-17a365d63c68 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:03.983655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 921/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:03.985948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:03.986243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:03.986519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.007517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:04.008784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.013760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c865b425641d402aae4a065659df939e', 'request_id': 'req-4f836fa9-e09b-4026-9180-c5b111dae4db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.019292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c865b425641d402aae4a065659df939e', 'request_id': 'req-4f836fa9-e09b-4026-9180-c5b111dae4db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.027304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c865b425641d402aae4a065659df939e', 'request_id': 'req-4f836fa9-e09b-4026-9180-c5b111dae4db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.039149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] The token cache is being invalidate because project c865b425641d402aae4a065659df939e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:04.039510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.040155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.041787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 939/1860] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:03 2022] DELETE /identity/v3/projects/c865b425641d402aae4a065659df939e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.042588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.043968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.070950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 922/1861] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:04.071955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.073217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.085750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d7f40-0f59-493c-a4a8-6664254e186e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.090537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.091219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.091500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.091771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] PATH_INFO: `/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.092891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84c2f251bf74ebeb3b1db5e2ebe8816)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.095387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.114864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f836fa9-e09b-4026-9180-c5b111dae4db admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.119970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.120653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.120936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.121212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] PATH_INFO: `/v3/projects/22d1376c803c49219f9117b674c00d67/users/159e886bd34646c286a0ef5648b1ce7f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.133131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:04.137569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d1376c803c49219f9117b674c00d67, user_id=159e886bd34646c286a0ef5648b1ce7f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.140349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.152071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84c2f251bf74ebeb3b1db5e2ebe8816', 'request_id': 'req-904e0416-2aeb-4efe-b353-b42468c55370'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.153169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 940/1862] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:04 2022] PUT /identity/v3/projects/22d1376c803c49219f9117b674c00d67/users/159e886bd34646c286a0ef5648b1ce7f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.156187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.158521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.160399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84c2f251bf74ebeb3b1db5e2ebe8816', 'request_id': 'req-904e0416-2aeb-4efe-b353-b42468c55370'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.166746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84c2f251bf74ebeb3b1db5e2ebe8816', 'request_id': 'req-904e0416-2aeb-4efe-b353-b42468c55370'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.178300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] The token cache is being invalidate because project e84c2f251bf74ebeb3b1db5e2ebe8816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:04.178582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.179264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.184027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 923/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:04 2022] DELETE /identity/v3/projects/e84c2f251bf74ebeb3b1db5e2ebe8816 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.184027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.184027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.193138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:04.225142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331269-914a-4167-bcb2-072efc987a30 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.229909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.230513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.230797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.231103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.231751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.233343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.243940 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 941/1864] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:04.244746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.248499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0416-2aeb-4efe-b353-b42468c55370 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.248690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.253300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.253943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.254226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.254501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] PATH_INFO: `/v3/users/ac498dd87c564242b5f78cab204f87cd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.255662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac498dd87c564242b5f78cab204f87cd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.257661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.306003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac498dd87c564242b5f78cab204f87cd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.307962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665bfdf-9337-4c2a-9564-528d0532f469 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.311682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.312257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.312533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.312803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.313622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac498dd87c564242b5f78cab204f87cd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.314531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac498dd87c564242b5f78cab204f87cd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.314721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.315174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac498dd87c564242b5f78cab204f87cd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.322342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-36c9ddfa-5ce2-4e57-ab85-36d16cb6f81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac498dd87c564242b5f78cab204f87cd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:04.326047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.327516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.337701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 942/1865] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:04.338496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.339851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.343535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 924/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:04 2022] DELETE /identity/v3/users/ac498dd87c564242b5f78cab204f87cd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.343535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.343535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.343535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.362357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f5e2c-1729-40ec-9d0a-4018475c93ba service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.363317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:04.365066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.405064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:04.454680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 925/1867] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:04.454680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.454680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.457389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.460363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.461015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.461489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.462531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.464645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e021863-9445-4d08-b524-195ac5420a4e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.465855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40220e-3162-4c22-b44a-270a8d68a583 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.472999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.473679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.473959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.474289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] PATH_INFO: `/v3/projects/559bfc88013b4dfea8699360696673b0/users/5446397f40854a9981522e29a53cc314/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.482196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 943/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:04.488116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03225a-101e-4fd2-8dab-fa304fbb41bc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.488116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03225a-101e-4fd2-8dab-fa304fbb41bc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.488359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03225a-101e-4fd2-8dab-fa304fbb41bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.505066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559bfc88013b4dfea8699360696673b0, user_id=5446397f40854a9981522e29a53cc314, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.512295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.528320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6d03225a-101e-4fd2-8dab-fa304fbb41bc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:04.529547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6d03225a-101e-4fd2-8dab-fa304fbb41bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.532891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 926/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:04 2022] PUT /identity/v3/projects/559bfc88013b4dfea8699360696673b0/users/5446397f40854a9981522e29a53cc314/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.540002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.542550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.600028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 944/1870] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:04.603397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c69a-e59e-459c-9d13-b973def5c686 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.603397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c69a-e59e-459c-9d13-b973def5c686 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.603397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c69a-e59e-459c-9d13-b973def5c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.618409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4b3e3-87b4-4deb-a6ad-2341dffd3965 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.620279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:04.625140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.626563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.626736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.627014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] PATH_INFO: `/v3/projects/22d1376c803c49219f9117b674c00d67/users/159e886bd34646c286a0ef5648b1ce7f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.629723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d1376c803c49219f9117b674c00d67, user_id=159e886bd34646c286a0ef5648b1ce7f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.632099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.636838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9f51c69a-e59e-459c-9d13-b973def5c686 None None] MFA Rules not processed for user `5446397f40854a9981522e29a53cc314`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:04.638241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f51c69a-e59e-459c-9d13-b973def5c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.647885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 927/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:04 2022] PUT /identity/v3/projects/22d1376c803c49219f9117b674c00d67/users/159e886bd34646c286a0ef5648b1ce7f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:04.647885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.728187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a992b-e156-4a08-8a23-061dc23f0936 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.731636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 945/1872] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:04.732994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.733287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.733564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.735400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.736193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.736756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.737309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.738265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:04.738800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.741473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.757815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 928/1873] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:04.761956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.770545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] MFA Rules not processed for user `159e886bd34646c286a0ef5648b1ce7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:04.772010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.778368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f986-e2e2-4d05-9a4e-a4eccbd8b459 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.788444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.789130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.789437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.789687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.790331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.796651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:04.838707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 929/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/projects => generated 409 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:04.839639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.883987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 946/1875] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:04.893463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:04.895698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:04.900789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:04.919161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892df90-e352-4304-94b5-d9ed0b7b8742 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.970911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeca-85e0-43ce-a9ac-09992f839994 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:04.976460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:04.977079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:04.977370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:04.977646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:04.978288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:04.980552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.012641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.013321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.014465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.014465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] PATH_INFO: `/v3/projects/03a182a511f946c984eabe339852ab48` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.015133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a182a511f946c984eabe339852ab48)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.020091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 930/1876] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:04 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:05.020261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.020365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.020365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.050792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:05.079804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a182a511f946c984eabe339852ab48', 'request_id': 'req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.087604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a182a511f946c984eabe339852ab48', 'request_id': 'req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.090830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902b64b-431a-4e63-9df5-9adecb74744c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.101582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a182a511f946c984eabe339852ab48', 'request_id': 'req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.123178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] The token cache is being invalidate because project 03a182a511f946c984eabe339852ab48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:05.123657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.124503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.126786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 947/1877] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:04 2022] DELETE /identity/v3/projects/03a182a511f946c984eabe339852ab48 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:05.127655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.128980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.160724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.161362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.161638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.161912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] PATH_INFO: `/v3/projects/07584918edf649e0a2184edbb2d856e7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.163057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07584918edf649e0a2184edbb2d856e7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.165119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.195743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8d50-6e62-4ab4-b92a-4c6d246585a6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.200898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.201512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.201792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.202071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.202703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.204728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.212332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07584918edf649e0a2184edbb2d856e7', 'request_id': 'req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.213927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:05.220222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07584918edf649e0a2184edbb2d856e7', 'request_id': 'req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.226669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 948/1878] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:05 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:05.227463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07584918edf649e0a2184edbb2d856e7', 'request_id': 'req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.227592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.229100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.239691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] The token cache is being invalidate because project 07584918edf649e0a2184edbb2d856e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:05.239983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.240696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.242476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 931/1879] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:05 2022] DELETE /identity/v3/projects/07584918edf649e0a2184edbb2d856e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:05.243262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.244621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.289380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208e5f-0e15-48c5-86c8-007ee838c065 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.307236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8adff-2a86-4cc0-b7f0-d42e20aa6391 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.311927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.312540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.312817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.313138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.314275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.316225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa36f5-c0ae-4a1a-8e7d-8c25ce1aee51 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.340605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 932/1880] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:05 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:05.340808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.340808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.341022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.341117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.341225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.341317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.341401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.342868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.353907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:05.359508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:05.361238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.370347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 933/1881] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:05.371153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.374042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.385645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba857c-c384-466a-8719-72d7b4913e90 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.391606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.392218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.392499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.392772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.393416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.395046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.405110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 934/1882] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:05.405903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.408012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.412659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.414967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.421479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8709-3a5e-42b6-951d-2abe4e94f641 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.426002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 949/1883] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:05.426859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.427612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.427889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.428162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] PATH_INFO: `/v3/users/4d8acbe0944e4eddb0c3c8f0868755c6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.429503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8acbe0944e4eddb0c3c8f0868755c6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.431552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.435710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.446330 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebc174-a3d5-4c0c-bcc9-c5063267596c service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.451061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.451683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.451967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.452412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.452922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.454637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a158d-e93e-4c22-a0e0-1f51bd26a987 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.469981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 950/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:05.471491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.471781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.472071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.496738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:05.497964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.501057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8acbe0944e4eddb0c3c8f0868755c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.506732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 951/1885] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:05.507679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.511803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8acbe0944e4eddb0c3c8f0868755c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.512435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8acbe0944e4eddb0c3c8f0868755c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.513200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8acbe0944e4eddb0c3c8f0868755c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.518482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaefaa-7274-41c3-8b10-931a1d34363a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.521477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8acbe0944e4eddb0c3c8f0868755c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.523938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.524706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.525094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.525440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] PATH_INFO: `/v3/projects/317cae941c0648fb8da7b03bf2ebd323/users/0c673655a3aa4839a0397c2261a4df56/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.542312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=317cae941c0648fb8da7b03bf2ebd323, user_id=0c673655a3aa4839a0397c2261a4df56, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.545113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.545629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 935/1886] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:05 2022] DELETE /identity/v3/users/4d8acbe0944e4eddb0c3c8f0868755c6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:05.548547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.551603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.567958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 952/1887] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:05 2022] PUT /identity/v3/projects/317cae941c0648fb8da7b03bf2ebd323/users/0c673655a3aa4839a0397c2261a4df56/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:05.571762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.573545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.600709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=5,keystone:DELETE=13,keystone:SELECT=82 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:05.645918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245d59-fbe9-4e16-b1ba-9ffa4d9f429d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.663246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0d0e-35ec-48f5-8984-9d7dc998c53b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.669223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.669866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.670149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.670425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.671245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:05.671556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.673783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.693258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 953/1888] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:05.693258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.695172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.708131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af2eb-e423-4a8b-be31-ead40c695560 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.710762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.711565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.711778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.712004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.712757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.714689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.730466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 936/1889] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:05.731448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.731561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.732727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.733061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.733274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.734199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.735784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.743311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.749772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882506e-59b9-4695-8473-e4109fe6aacd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.754680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.755363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.755641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.755910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] PATH_INFO: `/v3/users/e12ea38766be4cda94b7bf414f777c98` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.757077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12ea38766be4cda94b7bf414f777c98)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.760410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.764095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 954/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:05.765276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.781295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5fb0-fc85-43a3-9839-22eaaf3aca28 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.787806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:05.788494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:05.788796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:05.789071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:05.790126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:05.792151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:05.819641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12ea38766be4cda94b7bf414f777c98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.829919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 955/1891] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:05 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:05.831115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12ea38766be4cda94b7bf414f777c98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.831694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.831847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12ea38766be4cda94b7bf414f777c98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.833930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.834660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12ea38766be4cda94b7bf414f777c98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.847077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12ea38766be4cda94b7bf414f777c98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:05.874282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:05.875976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 937/1892] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:05 2022] DELETE /identity/v3/users/e12ea38766be4cda94b7bf414f777c98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:05.877676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:05.879730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:05.926797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b725-a73e-4326-8994-2d57a0698ef7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:05.961520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:06.010523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b14e-d782-476f-b64e-caa00de92d33 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.020019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.021130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.021733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.022015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] PATH_INFO: `/v3/projects/317cae941c0648fb8da7b03bf2ebd323/users/0c673655a3aa4839a0397c2261a4df56/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.024178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317cae941c0648fb8da7b03bf2ebd323, user_id=0c673655a3aa4839a0397c2261a4df56, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.027867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.030417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.031134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.031418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.031747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] PATH_INFO: `/v3/projects/2d233afd940a422da722c22bc68f3c87/users/042180ec3f914a2aaef7e4d788aa2917/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.049766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d233afd940a422da722c22bc68f3c87, user_id=042180ec3f914a2aaef7e4d788aa2917, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.052553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa975-6ef7-42e1-a0ed-d6e76524ad38 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.055415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 938/1893] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:05 2022] PUT /identity/v3/projects/317cae941c0648fb8da7b03bf2ebd323/users/0c673655a3aa4839a0397c2261a4df56/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:06.056320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.059494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.081742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 956/1894] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:05 2022] PUT /identity/v3/projects/2d233afd940a422da722c22bc68f3c87/users/042180ec3f914a2aaef7e4d788aa2917/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:06.081742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.081742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.081742 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.109936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.110900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.168470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e317e-5446-46b3-9304-61c51a6b3bf6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.192242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 957/1895] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:06.193852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.196467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.212957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765ece1-cf74-41a2-b410-b9dcf106846a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.220235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.221577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.222317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.222598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] PATH_INFO: `/v3/projects/ba7b9eaf35224225b79cc14722483405` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.225268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7b9eaf35224225b79cc14722483405)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.227694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.246826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.247699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.247985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.248259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.248901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.251436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f629d8f-5feb-4bc1-8029-792d3bb2beb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.299389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 939/1896] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:06.301331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.301750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.302035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.317752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7b9eaf35224225b79cc14722483405', 'request_id': 'req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:06.320141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:06.327192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7b9eaf35224225b79cc14722483405', 'request_id': 'req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:06.331660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] MFA Rules not processed for user `0c673655a3aa4839a0397c2261a4df56`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.332864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.339748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7b9eaf35224225b79cc14722483405', 'request_id': 'req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:06.352542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] The token cache is being invalidate because project ba7b9eaf35224225b79cc14722483405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:06.352542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:06.353233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ec4dc6a9-bb4e-425b-807c-4cdf466f28ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:06.355047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 958/1897] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:06 2022] DELETE /identity/v3/projects/ba7b9eaf35224225b79cc14722483405 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:06.356084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.356370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.356646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.388668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] MFA Rules not processed for user `042180ec3f914a2aaef7e4d788aa2917`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.390437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.398683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:06.414375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 940/1898] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:06.415250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.416783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.474779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 959/1899] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:06.475799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.477168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.479403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a236-b159-4564-98fe-2397b70eea3a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.483000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.483635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.484184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.484454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.486726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.543066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650c33-d7cf-49a1-870a-27a3afab1d8d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.547966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.548157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.548760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.549038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.549304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.549396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998bf5a-0d88-4af6-a6c0-373e2745d8c3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.549937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.551558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.558835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 941/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:06.560088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.560354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.560628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.565024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 960/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:06.565024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.565024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.580576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.581778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.591248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 942/1902] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:06.592065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.593345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.606074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf251149-8f4c-48f8-b384-60e5d96f5346 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.612047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.612661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.612942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.613633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.614651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.616223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.639501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138706f-cd4a-4491-9aaa-f696c4fde730 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.644047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.644680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.644993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.645236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.650008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 943/1903] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:06.650846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.663610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.665421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebbd29-0da6-442b-8dc6-c95d73e58114 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.682332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 961/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:06.684552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.685051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.685491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.721445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.723292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efae80-e920-40c6-9ae2-44272e07ef6b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.724181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.728965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.729499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.729791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.730068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.730684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.732962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.739883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 962/1905] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:06.741254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.750196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 944/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:06.750196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.756159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:06.764832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9c33-e45b-42aa-a1ca-51eda6032b43 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.770845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ebdf6-eb17-4c8f-b298-29816cf47a3e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.772089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.772954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.773419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.774344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.775736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:06.776181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.777951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.781706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.782270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.782993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.783575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.784728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.787301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:06.789041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.800158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 945/1907] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:06.801079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.818506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd7575-4ec5-497c-9ffc-c9c3bdda04e7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.824347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.825023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.825377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.825722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] PATH_INFO: `/v3/projects/22d7d948ebd1495591702dd7eda33e8d/users/009fadf36fcb4217bfa8c5492eb3bc2b/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.831250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 963/1908] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:06.832966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.844066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517876-0b32-49e8-a740-d4de048c28e5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:06.848640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d7d948ebd1495591702dd7eda33e8d, user_id=009fadf36fcb4217bfa8c5492eb3bc2b, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.850136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:06.850813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.851188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.851525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.852244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:06.853075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.854270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7be7-3fb5-4944-b807-613d43d5fdd2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:06.883336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 946/1909] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:06 2022] PUT /identity/v3/projects/22d7d948ebd1495591702dd7eda33e8d/users/009fadf36fcb4217bfa8c5492eb3bc2b/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:06.886229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:06.890542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 964/1910] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:06.891710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:06.892013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:06.892263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:06.927862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] MFA Rules not processed for user `009fadf36fcb4217bfa8c5492eb3bc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:06.929514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:06.977264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797e53-b3ca-4ee5-8549-25191822422f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.021118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 965/1911] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:07.021948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.041111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.041722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.041998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.042267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.042902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.044541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.055257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 947/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:07.056277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.058073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.070596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da907-10b3-4426-9904-178b434cd063 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.075568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.076384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.076666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.076939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] PATH_INFO: `/v3/projects/9ee9f86ea404476e95138cca1634d5db` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.078078 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee9f86ea404476e95138cca1634d5db)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.080102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.085045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def66108-0554-4a76-b04c-2063aef82ed3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.089827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.090466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.090751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.091014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.091676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.093573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.122086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 966/1913] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:07 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:07.122086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.131923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee9f86ea404476e95138cca1634d5db', 'request_id': 'req-4eafe969-f952-4e6a-bef5-c6f22e8c76be'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.139621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee9f86ea404476e95138cca1634d5db', 'request_id': 'req-4eafe969-f952-4e6a-bef5-c6f22e8c76be'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.145338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee9f86ea404476e95138cca1634d5db', 'request_id': 'req-4eafe969-f952-4e6a-bef5-c6f22e8c76be'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.153667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:07.158539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] The token cache is being invalidate because project 9ee9f86ea404476e95138cca1634d5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:07.158871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.160053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.164788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 948/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:07 2022] DELETE /identity/v3/projects/9ee9f86ea404476e95138cca1634d5db => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:07.164788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.164788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.171617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:07.184035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6213220-64ec-4a1b-8437-d3804cb11956 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.222510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe969-f952-4e6a-bef5-c6f22e8c76be admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.226167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.226774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.227073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.227351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.229097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.232631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.233247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.233529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.233807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.236405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.291053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.292504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.295558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.297807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.303551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 949/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:07.304561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.306158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.307353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 967/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:07.308187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.309492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.399700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecbe0a-9d6b-471d-b4c6-2d6531f52a65 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.416862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.417504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.417843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.418131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.418771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.420587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.437325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99a401-4a99-49b1-986f-b30f300fc42c service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.449530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 968/1917] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:07.450413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.456817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.458094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.458826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.459641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.460402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] PATH_INFO: `/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0/users/e402d9fd598f49e2b06e70795353cb82/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.487775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30710-cbe4-47f6-b386-f5ef6d231858 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.513237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.513237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.513237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.513237 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] PATH_INFO: `/v3/users/159e886bd34646c286a0ef5648b1ce7f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.513950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159e886bd34646c286a0ef5648b1ce7f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.513950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.517562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ceecb086544ad7a51ca2b7674eb3a0, user_id=e402d9fd598f49e2b06e70795353cb82, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.521417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.545991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 950/1918] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:07 2022] PUT /identity/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0/users/e402d9fd598f49e2b06e70795353cb82/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:07.546605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.651739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:07.692093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:07.699168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159e886bd34646c286a0ef5648b1ce7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.709037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f0ff-82af-400e-b045-6ba05ee5297f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.721447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159e886bd34646c286a0ef5648b1ce7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.722583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159e886bd34646c286a0ef5648b1ce7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.723610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159e886bd34646c286a0ef5648b1ce7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.724529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.725298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.725575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.725856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.726526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.728166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.751719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 951/1919] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:07.752635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159e886bd34646c286a0ef5648b1ce7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:07.754941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.759269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.793061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 969/1920] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:07 2022] DELETE /identity/v3/users/159e886bd34646c286a0ef5648b1ce7f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:07.793287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f77c4-c49f-485b-b14f-b65fe104811b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:07.795560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:07.799273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:07.954306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:07.955145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:07.955487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:07.955767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:07.956773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:07.960717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:07.993339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 952/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:07.997736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.021359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112e03-2dae-4140-b233-528a33ab049a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.029053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7a0a-8672-4906-b06f-25bc23d3efe5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.036861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.038019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.038464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.038878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] PATH_INFO: `/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0/users/e402d9fd598f49e2b06e70795353cb82/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.043329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ceecb086544ad7a51ca2b7674eb3a0, user_id=e402d9fd598f49e2b06e70795353cb82, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.046628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80898667-5e64-42ef-a606-8b36a68f432b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.053677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.054410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.056377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.056691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] PATH_INFO: `/v3/projects/1e95167937db48b2b7a0f7321ddb2891/users/11530e46918b4316a476b1722d14e05a/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.087091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 953/1922] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:07 2022] PUT /identity/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0/users/e402d9fd598f49e2b06e70795353cb82/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:08.100175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.100382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.100654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.115023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e95167937db48b2b7a0f7321ddb2891, user_id=11530e46918b4316a476b1722d14e05a, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.118350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c263e84-fb3b-415b-a23f-31707facba4e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.149526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 970/1923] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:07 2022] PUT /identity/v3/projects/1e95167937db48b2b7a0f7321ddb2891/users/11530e46918b4316a476b1722d14e05a/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:08.160217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.160217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.160217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.163480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] MFA Rules not processed for user `e402d9fd598f49e2b06e70795353cb82`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:08.164165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.220087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] MFA Rules not processed for user `11530e46918b4316a476b1722d14e05a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:08.224906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.291383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 954/1924] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:08.304775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.306233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.330522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 971/1925] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:08.334595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.372937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:08.379193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:08.387516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6c7cb-5a1a-489c-85ec-54a1bec05c6f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.391989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.392669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.393032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.393303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.403694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.405253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.415496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287195-0934-42d7-b871-0daad6a2f4cd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.417150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 955/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:08.418007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.419400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.420293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.420914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.421198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.421475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.422115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.424684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.444978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efd5b-1c29-4fd9-9b19-3542c3063ee2 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.449981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.450618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.451008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.451316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] PATH_INFO: `/v3/projects/22d1376c803c49219f9117b674c00d67` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.453423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d1376c803c49219f9117b674c00d67)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.455109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.456504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 972/1927] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:08.469719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.521781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d1376c803c49219f9117b674c00d67', 'request_id': 'req-3a810aac-393b-4647-a0fd-52270652d1a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.532177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d1376c803c49219f9117b674c00d67', 'request_id': 'req-3a810aac-393b-4647-a0fd-52270652d1a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.538376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d1376c803c49219f9117b674c00d67', 'request_id': 'req-3a810aac-393b-4647-a0fd-52270652d1a3'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.546625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0358-b01e-441c-9c0b-4b192d76d7e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.553533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] The token cache is being invalidate because project 22d1376c803c49219f9117b674c00d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:08.553883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.554655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.556541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 956/1928] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:08 2022] DELETE /identity/v3/projects/22d1376c803c49219f9117b674c00d67 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:08.558740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.560365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.632149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.632773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.633050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.633319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.633953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.634713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810aac-393b-4647-a0fd-52270652d1a3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.636960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c45f0-54b4-4d90-9860-ea28617ba7bf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.640488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.641443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.641716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.642153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] PATH_INFO: `/v3/users/042180ec3f914a2aaef7e4d788aa2917` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.643447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042180ec3f914a2aaef7e4d788aa2917)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.645377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.671849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 973/1929] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:08.671849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.671849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.671849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.712471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:08.713853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042180ec3f914a2aaef7e4d788aa2917'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.713999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.724841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042180ec3f914a2aaef7e4d788aa2917'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.725497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042180ec3f914a2aaef7e4d788aa2917'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.731078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 974/1930] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:08.731078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.732537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042180ec3f914a2aaef7e4d788aa2917'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.733026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.742130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47eb629d-4338-43ad-b480-3b94a21366e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042180ec3f914a2aaef7e4d788aa2917'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:08.748766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086435-a823-4df8-8f0d-2ad01bc532a4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.749608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:08.757076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.757686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.757965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.758301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.759188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.761673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79266645-4bb6-4bc6-b287-540f5faa7fb5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.769107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 957/1931] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:08 2022] DELETE /identity/v3/users/042180ec3f914a2aaef7e4d788aa2917 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:08.770951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.771473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.772227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.779781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 975/1932] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:08.780722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.781142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.781528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.811004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:08.812494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.827953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:08.829732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.879093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:08.942493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 976/1933] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:08.943801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.949454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.951505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 958/1934] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:08.955993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.964744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d652b-e5f5-4c4d-a6d7-46f15ae8cdd5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.966073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafe4b-de8b-449d-a47a-9ab63a8af4d7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:08.970495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.971277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.971616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:08.971747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.971970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] PATH_INFO: `/v3/projects/6b18ab32f0db4b63805f400f313b01a6/users/0f7335b6d5c24f88b13a638519813176/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.972225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:08.972506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:08.972781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:08.973443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:08.973776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.976607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:08.990083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 959/1935] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:14:08.990956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:08.994124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b18ab32f0db4b63805f400f313b01a6, user_id=0f7335b6d5c24f88b13a638519813176, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:08.995069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:08.997719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.012461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 977/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:08 2022] PUT /identity/v3/projects/6b18ab32f0db4b63805f400f313b01a6/users/0f7335b6d5c24f88b13a638519813176/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:09.013261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.071790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0c2f0-038c-43b9-b5bf-1d09605619cb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.088803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82db58-0308-4404-8b6b-d74a2daa8fba admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.095466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.096129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.096416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.096694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.097334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.099511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.128829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.129558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.129908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.130259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.140950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.143137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.145580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 978/1937] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:09 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:09.146620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.155284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 960/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:09.155985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.165642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd71f1-d63a-4de5-b85b-7a9420f78068 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.205531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:09.231791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e5f6d-0523-49c4-8592-89829db947ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.238136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.238798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.239138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.239374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.240002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.241629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.247221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.248444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.248846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.249153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.249878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.253101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.258439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 979/1939] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:09.260133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.286612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 961/1940] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:09 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:09.287574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.292851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa687f2-3299-464a-bb4f-38527d05e9fd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.300027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.300960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.301279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.301562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] PATH_INFO: `/v3/projects/6b18ab32f0db4b63805f400f313b01a6/users/0f7335b6d5c24f88b13a638519813176/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.302166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb16ff-130c-47f3-afbf-91c72974f6be admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.303949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b18ab32f0db4b63805f400f313b01a6, user_id=0f7335b6d5c24f88b13a638519813176, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.306935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d73f8-4e4b-4305-9234-14b5a20523aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.332689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.333446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.333790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.334132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.334924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.336884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.341338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 980/1941] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:09 2022] PUT /identity/v3/projects/6b18ab32f0db4b63805f400f313b01a6/users/0f7335b6d5c24f88b13a638519813176/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:09.353475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09302-b37c-4fe1-acde-387810713563 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.353757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09302-b37c-4fe1-acde-387810713563 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.354124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e09302-b37c-4fe1-acde-387810713563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.370132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 962/1942] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:09.371977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.389770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af40af-9088-4a0e-ae5e-0d832dc51878 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.403309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-63e09302-b37c-4fe1-acde-387810713563 None None] MFA Rules not processed for user `0f7335b6d5c24f88b13a638519813176`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:09.404993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-63e09302-b37c-4fe1-acde-387810713563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.417266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:09.477826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.478490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.478854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.479311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.480106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.481924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.498400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 963/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:09.499567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.500102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 981/1944] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:09.512848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e09302-b37c-4fe1-acde-387810713563 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.514264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-63e09302-b37c-4fe1-acde-387810713563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.517738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9864-1160-4dc9-9c65-e62f4825b3ce admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.524214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.525481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.525845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.526204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] PATH_INFO: `/v3/projects/b00aa31ce1d540d7bcc0a8e49cee54d2/users/1ebd9bada7e8444a91ceaafa54c2ca02/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.552835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00aa31ce1d540d7bcc0a8e49cee54d2, user_id=1ebd9bada7e8444a91ceaafa54c2ca02, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.556469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.593391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 964/1945] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:09 2022] PUT /identity/v3/projects/b00aa31ce1d540d7bcc0a8e49cee54d2/users/1ebd9bada7e8444a91ceaafa54c2ca02/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:09.594213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.596205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.632258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e09302-b37c-4fe1-acde-387810713563 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.679414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d5-de5b-45cf-a52b-db32cd91b070 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.684306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.684738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.684966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.685246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.685348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.685521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] PATH_INFO: `/v3/projects/2d233afd940a422da722c22bc68f3c87` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.685631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.685866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.686665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d233afd940a422da722c22bc68f3c87)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.689303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.725411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:09.752229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d233afd940a422da722c22bc68f3c87', 'request_id': 'req-aade26a4-0a71-4248-9bdb-72798c7300aa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:09.762090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d233afd940a422da722c22bc68f3c87', 'request_id': 'req-aade26a4-0a71-4248-9bdb-72798c7300aa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:09.767522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.768991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a8f9-d61a-464e-8b06-f42b89389866 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.769112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d233afd940a422da722c22bc68f3c87', 'request_id': 'req-aade26a4-0a71-4248-9bdb-72798c7300aa'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:09.779931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 982/1946] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:09.781373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.781696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.781974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.783941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] The token cache is being invalidate because project 2d233afd940a422da722c22bc68f3c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:09.784284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:09.785278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:09.787247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 965/1947] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:09 2022] DELETE /identity/v3/projects/2d233afd940a422da722c22bc68f3c87 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:09.790741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.792436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.814090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:09.818541 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] MFA Rules not processed for user `1ebd9bada7e8444a91ceaafa54c2ca02`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:09.820225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.892807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade26a4-0a71-4248-9bdb-72798c7300aa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:09.902871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:09.903596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:09.903899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:09.904171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] PATH_INFO: `/v3/users/e402d9fd598f49e2b06e70795353cb82` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:09.905338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e402d9fd598f49e2b06e70795353cb82)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:09.908226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:09.949376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 983/1948] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:09.953521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:09.955506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:09.990144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59784c-3951-49d7-b318-99a0780374e0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.003553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.004295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.004582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.005299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.006019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.012195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.046649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e402d9fd598f49e2b06e70795353cb82'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:10.063656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e402d9fd598f49e2b06e70795353cb82'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:10.064559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e402d9fd598f49e2b06e70795353cb82'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:10.065360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e402d9fd598f49e2b06e70795353cb82'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:10.076650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 984/1949] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:09 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:10.081129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.086048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:10.087586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e402d9fd598f49e2b06e70795353cb82'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:10.148514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 966/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:09 2022] DELETE /identity/v3/users/e402d9fd598f49e2b06e70795353cb82 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:10.204071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186c58-9fc7-4dcf-b552-4de3254d2ae7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.299235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.299235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.299235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.299235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.299635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.302783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.338788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 985/1951] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:10 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:10.342553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.359928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c0729-9fe8-490e-8cda-aa95b3a916aa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.365630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.366501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.367344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.367460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.368261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.370513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b35dce-a1c7-4281-86fb-f38b2093b784 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.390025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 967/1952] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:10.394225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.404395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43531-7532-42c8-ac90-71e67f0c624b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.407293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43531-7532-42c8-ac90-71e67f0c624b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.408391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43531-7532-42c8-ac90-71e67f0c624b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.413130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 968/1953] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:14:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:14:10.413523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430584-15cc-442f-861c-5cc0d7a6f6c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.420872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.421763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.422052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.422382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] PATH_INFO: `/v3/projects/58b2c144b72540d0b8275fa536ff9a4b/users/b6deab8bd6314789b7eac54a4daaf3f1/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.460208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b2c144b72540d0b8275fa536ff9a4b, user_id=b6deab8bd6314789b7eac54a4daaf3f1, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.463931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae24c66-2c52-4e20-899b-6b7a294f35f5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.467297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:10.503422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 986/1954] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:10 2022] PUT /identity/v3/projects/58b2c144b72540d0b8275fa536ff9a4b/users/b6deab8bd6314789b7eac54a4daaf3f1/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:10.505843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43531-7532-42c8-ac90-71e67f0c624b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.564901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:10.588772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.589386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.589748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.697382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:10.702270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:10.713441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43531-7532-42c8-ac90-71e67f0c624b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.722560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.723676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.724168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.724913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.726481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.729713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.772035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 969/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:10.773710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.789853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413920d-37fc-482a-8f8b-7d9eb2db2bd8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:10.795622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:10.796453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.796812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.798438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] PATH_INFO: `/v3/projects/58b2c144b72540d0b8275fa536ff9a4b/users/b6deab8bd6314789b7eac54a4daaf3f1/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.802166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b2c144b72540d0b8275fa536ff9a4b, user_id=b6deab8bd6314789b7eac54a4daaf3f1, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:10.808271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb15c71-0863-47db-b68e-4595d92aa0dd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:10.865419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 970/1956] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:10 2022] PUT /identity/v3/projects/58b2c144b72540d0b8275fa536ff9a4b/users/b6deab8bd6314789b7eac54a4daaf3f1/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:10.877416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165805e-c3da-449e-a378-0a807af74760 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:10.877839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165805e-c3da-449e-a378-0a807af74760 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:10.878113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165805e-c3da-449e-a378-0a807af74760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:10.912765 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 987/1957] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:10.931610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:10.934795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:10.965542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e165805e-c3da-449e-a378-0a807af74760 None None] MFA Rules not processed for user `b6deab8bd6314789b7eac54a4daaf3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:10.969193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e165805e-c3da-449e-a378-0a807af74760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:10.972725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82765d0-4800-4368-9914-6c4076079df6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:11.140399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:11.143438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:11.143907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:11.145499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:11.150628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 971/1958] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:11.180291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:11.189240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:11.235194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 988/1959] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:11.239765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165805e-c3da-449e-a378-0a807af74760 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:11.241314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e165805e-c3da-449e-a378-0a807af74760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:11.320017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165805e-c3da-449e-a378-0a807af74760 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:11.326278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:11.326839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:11.327154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:11.327432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:11.354352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:11.360639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:11.386987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 972/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:11.635872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:11.649999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5357d-3f35-4fd2-9db3-f41929ddbb55 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:11.656469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:11.657839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:11.658118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:11.658401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:11.660714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:11.703310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:11.704947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:11.745208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:11.746660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112df56-824e-40f9-8685-55d032af1498 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:11.770881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 989/1961] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:11.776367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:11.842515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b50fb-8903-4614-8cda-0d058fb175ed service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:11.849931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:11.850584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:11.850865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:11.851177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] PATH_INFO: `/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:11.852335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ceecb086544ad7a51ca2b7674eb3a0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:11.854261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:11.912654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ceecb086544ad7a51ca2b7674eb3a0', 'request_id': 'req-a580f582-88ae-4082-a3da-c1759bb42acd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:11.922192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ceecb086544ad7a51ca2b7674eb3a0', 'request_id': 'req-a580f582-88ae-4082-a3da-c1759bb42acd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:11.929940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ceecb086544ad7a51ca2b7674eb3a0', 'request_id': 'req-a580f582-88ae-4082-a3da-c1759bb42acd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:11.945958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] The token cache is being invalidate because project 33ceecb086544ad7a51ca2b7674eb3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:11.946596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:11.948150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a580f582-88ae-4082-a3da-c1759bb42acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:11.954155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 973/1962] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:11 2022] DELETE /identity/v3/projects/33ceecb086544ad7a51ca2b7674eb3a0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:11.956231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:11.956850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:11.957331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:11.988893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:11.989820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:11.995336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:12.065505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 990/1963] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:12.078278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.079211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.079585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.122588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:12.124109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:12.162350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 974/1964] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:12.166672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.179689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb83d-9c6b-4b68-bd82-5bdb333370b7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.185090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.186090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.186594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.187095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.188623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:12.189113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.190962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.207466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 991/1965] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:12.211918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.225760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb396bf-09c9-4b2f-aaa1-5f7d7d8e5cf6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.233029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.233737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.234334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.234703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.235619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.237685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.296813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 975/1966] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:12.300709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.314965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c21418-1691-4849-8001-0c908a4f8ca3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.433404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.434591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.434938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.435336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.436200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.440456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.472318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 992/1967] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:12.476489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.492743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ae972-5928-414e-a6b6-1bed0636fbf8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.499089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.499723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.500004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.500332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.501561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.509140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.526387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 976/1968] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:12.530385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.540819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ce75c-b1f0-4165-acfe-4bae0de677b2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.548204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.549036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.549800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.550460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.551715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.564482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231347-b814-4c2c-8a9e-0ac354debbe4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.583124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 993/1969] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:12.586059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.597264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fa7e-0a54-4557-bbb4-0473f9c415ab admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.602162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.602762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.603055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.603363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] PATH_INFO: `/v3/projects/98446d2ca3a9415e9a7d825d27be0186/users/525cdd48790b4cb39d63eda95f705503/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.622363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98446d2ca3a9415e9a7d825d27be0186, user_id=525cdd48790b4cb39d63eda95f705503, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.625101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.643215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 977/1970] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:12 2022] PUT /identity/v3/projects/98446d2ca3a9415e9a7d825d27be0186/users/525cdd48790b4cb39d63eda95f705503/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:12.653395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.653890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.653985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.691323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] MFA Rules not processed for user `525cdd48790b4cb39d63eda95f705503`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:12.692867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:12.770278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 994/1971] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:12.775563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.855769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1dd00-be15-4374-bd7e-86419285df98 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:12.863603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:12.864927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:12.865534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:12.866135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:12.867536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:12.871245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:12.879465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:12.926715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 978/1972] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:12.930417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:12.938692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:12.943863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e0601-5b99-4cd7-a4a5-79e7d0ab759b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.053784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.054407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.054867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.055443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.056264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.058323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.087734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 995/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:12 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:13.091936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.103180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9503f7-a6e6-4673-9209-c25b6cbc2f83 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.106262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.108207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:13.122259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a6adc-5807-4189-8057-c56566b7c1d1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.124430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.125229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.125632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.126052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.126871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.128275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.128708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.129478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.130386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.131828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] PATH_INFO: `/v3/users/11530e46918b4316a476b1722d14e05a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.133854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11530e46918b4316a476b1722d14e05a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.137992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.140004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 979/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:13.143965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.154941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e0ef-59ce-4b24-8c44-fdca33190944 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.160469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.161081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.161490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.161773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.162422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.164743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.175840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 980/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:13.180634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.194001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30ec88-5649-43cf-b20e-99661c1298fe admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.199480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.200267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.200713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.201086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] PATH_INFO: `/v3/projects/8059cc970ad14a80b51b007f634c6166/users/f4be453a445843369fb6df46a407cccd/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.208426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11530e46918b4316a476b1722d14e05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:13.220455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8059cc970ad14a80b51b007f634c6166, user_id=f4be453a445843369fb6df46a407cccd, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.223276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0451e7-63ad-4643-91dd-d7a879add7a8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.226595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11530e46918b4316a476b1722d14e05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:13.227813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11530e46918b4316a476b1722d14e05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:13.228466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11530e46918b4316a476b1722d14e05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:13.243901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 981/1976] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:13 2022] PUT /identity/v3/projects/8059cc970ad14a80b51b007f634c6166/users/f4be453a445843369fb6df46a407cccd/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:13.259426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ccc38c1-53dc-4a2a-88d8-54dbb9ec0a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11530e46918b4316a476b1722d14e05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:13.259533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.259533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.259533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.266903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 996/1977] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:13 2022] DELETE /identity/v3/users/11530e46918b4316a476b1722d14e05a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:13.272006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.272372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.272729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.289127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] MFA Rules not processed for user `f4be453a445843369fb6df46a407cccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:13.290437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:13.298618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:13.300168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:13.388481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 982/1978] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:13.393876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.395281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:13.408714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 997/1979] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:13.420020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.422618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:13.436411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:13.488506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bebad-7c00-4929-a8a3-dccdc9393b02 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.493653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.494275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.494548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.494823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.495507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.497626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.507732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1eaa0-1168-4042-a8d7-7909678e8239 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.514780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.515666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.516560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.516993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.538265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.540074 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.540606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 983/1980] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:13 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:13.544983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.551363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 998/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:13.581240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:13.674114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99e1fb-3bca-419e-a3e2-6642642e9783 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.680483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.681110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.681462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.681854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.683127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.686014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.718512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 984/1982] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:13 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:13.722628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.745645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df001-ddc8-438a-a2bd-1b9d2aeaf67c service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.752900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.754103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.754673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.755172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.756147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.761962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.813854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 999/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:13.819019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:13.838928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5e256-4307-4317-a5fe-8b0fedb25188 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:13.852511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:13.853518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:13.854133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:13.854601 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] PATH_INFO: `/v3/projects/5d3648eb9cce439394f20ace4fae8bbb/users/375164c9218d400ead9516b682271218/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:13.894569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3648eb9cce439394f20ace4fae8bbb, user_id=375164c9218d400ead9516b682271218, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:13.901128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:13.991998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 985/1984] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:13 2022] PUT /identity/v3/projects/5d3648eb9cce439394f20ace4fae8bbb/users/375164c9218d400ead9516b682271218/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:13.996342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.015195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412b90-6e09-4e08-9921-c120fa1e97d5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.117423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.119395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.229130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.230123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.230423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.230716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.231435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.236120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.262122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1000/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:14.264278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.294194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1f1c-160a-4153-acd8-16f6f682db7f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.294424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666211fb-4505-4f98-a655-7998026c60af admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.311520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.311767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.312536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.313851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.314356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.314733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] PATH_INFO: `/v3/projects/1e95167937db48b2b7a0f7321ddb2891` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.315851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.316975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] PATH_INFO: `/v3/projects/5d3648eb9cce439394f20ace4fae8bbb/users/375164c9218d400ead9516b682271218/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.317798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e95167937db48b2b7a0f7321ddb2891)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.322579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.326621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3648eb9cce439394f20ace4fae8bbb, user_id=375164c9218d400ead9516b682271218, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.331548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182118a-506b-4383-8efb-dbf50357315a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.357711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1001/1986] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:14 2022] PUT /identity/v3/projects/5d3648eb9cce439394f20ace4fae8bbb/users/375164c9218d400ead9516b682271218/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:14.373312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.374041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.374041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.411598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] MFA Rules not processed for user `375164c9218d400ead9516b682271218`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:14.411598 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.412697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e95167937db48b2b7a0f7321ddb2891', 'request_id': 'req-bf93606c-fe20-479e-a3fd-c98d97087709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.425676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e95167937db48b2b7a0f7321ddb2891', 'request_id': 'req-bf93606c-fe20-479e-a3fd-c98d97087709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.433458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e95167937db48b2b7a0f7321ddb2891', 'request_id': 'req-bf93606c-fe20-479e-a3fd-c98d97087709'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.446665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] The token cache is being invalidate because project 1e95167937db48b2b7a0f7321ddb2891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:14.446962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.447672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.449599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 986/1987] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:14 2022] DELETE /identity/v3/projects/1e95167937db48b2b7a0f7321ddb2891 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:14.454210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.459014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.481952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:14.583414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93606c-fe20-479e-a3fd-c98d97087709 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.588738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1002/1988] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:14.602935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.604660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.605807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.607091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.607563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.608052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] PATH_INFO: `/v3/users/0f7335b6d5c24f88b13a638519813176` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.610622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7335b6d5c24f88b13a638519813176)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.615677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.618728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:14.715823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7335b6d5c24f88b13a638519813176'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.727684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae914f-3196-4870-91e8-554dce9f6c1d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.730891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7335b6d5c24f88b13a638519813176'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.732607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7335b6d5c24f88b13a638519813176'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.732857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.733755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.734380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.735371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.736011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7335b6d5c24f88b13a638519813176'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.738516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.768444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.770024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.776477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7335b6d5c24f88b13a638519813176'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:14.807914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1003/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:14.811914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.813055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 987/1990] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:14 2022] DELETE /identity/v3/users/0f7335b6d5c24f88b13a638519813176 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:14.813984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:14.819003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.832889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:14.845557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eff02f-3169-455e-9fc3-78ee9e348db0 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.947899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.948900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.949532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.949996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] PATH_INFO: `/v3/users/5446397f40854a9981522e29a53cc314` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.952472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5446397f40854a9981522e29a53cc314)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.963679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:14.967438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8eb13-b8e6-4414-a28d-f17b27278bf1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:14.975421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:14.976083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:14.976367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:14.976644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] PATH_INFO: `/v3/users/009fadf36fcb4217bfa8c5492eb3bc2b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:14.978530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009fadf36fcb4217bfa8c5492eb3bc2b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:14.980809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:15.036031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:15.055152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009fadf36fcb4217bfa8c5492eb3bc2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.064698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009fadf36fcb4217bfa8c5492eb3bc2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.065106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5446397f40854a9981522e29a53cc314'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.065614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009fadf36fcb4217bfa8c5492eb3bc2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.067135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009fadf36fcb4217bfa8c5492eb3bc2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.077420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009fadf36fcb4217bfa8c5492eb3bc2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.082674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5446397f40854a9981522e29a53cc314'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.085675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5446397f40854a9981522e29a53cc314'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.087157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5446397f40854a9981522e29a53cc314'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.108594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5de88d9f-c167-4ed5-994a-6de3b401a3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5446397f40854a9981522e29a53cc314'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.124776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 988/1991] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:14 2022] DELETE /identity/v3/users/009fadf36fcb4217bfa8c5492eb3bc2b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:15.127502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:15.128949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1004/1992] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:14 2022] DELETE /identity/v3/users/5446397f40854a9981522e29a53cc314 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:15.130502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50f48-d642-4c09-a2ca-4d3d899642ca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.130908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50f48-d642-4c09-a2ca-4d3d899642ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.131301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50f48-d642-4c09-a2ca-4d3d899642ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.134338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.156043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-99f50f48-d642-4c09-a2ca-4d3d899642ca None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:15.157391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-99f50f48-d642-4c09-a2ca-4d3d899642ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.198867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:15.233292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dbee-ca48-4cf3-81af-42ba004e88b7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:15.258389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1005/1993] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:15.258389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.258389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.258389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.296057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:15.297499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.305712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1006/1994] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:15.307079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:15.316070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.326432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:15.327086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.327373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.327651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.330036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.330470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f01ac-0615-4911-b800-1d20b562cd2b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:15.335208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:15.336030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.336452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.336884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] PATH_INFO: `/v3/projects/6b18ab32f0db4b63805f400f313b01a6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.338147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b18ab32f0db4b63805f400f313b01a6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:15.340144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:15.407810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b18ab32f0db4b63805f400f313b01a6', 'request_id': 'req-c3ae1912-6db9-4226-9491-fad5f2849ba6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.415257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b18ab32f0db4b63805f400f313b01a6', 'request_id': 'req-c3ae1912-6db9-4226-9491-fad5f2849ba6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.419107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:15.420795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:15.428911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b18ab32f0db4b63805f400f313b01a6', 'request_id': 'req-c3ae1912-6db9-4226-9491-fad5f2849ba6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.435065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 989/1995] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:15.436163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:15.438136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.452750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] The token cache is being invalidate because project 6b18ab32f0db4b63805f400f313b01a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:15.453095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.454464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:15.459089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1007/1996] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:15 2022] DELETE /identity/v3/projects/6b18ab32f0db4b63805f400f313b01a6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:15.459089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:15.461624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.475688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:15.535566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960de2b-78e5-4ae8-8a21-65beabcbc33e service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:15.571017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1912-6db9-4226-9491-fad5f2849ba6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:15.575322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:15.577106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.577793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.578299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.580382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.622585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:15.623360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.626321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.628087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.631814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.691846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:15.694755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:15.698739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4adcd-c098-4bb9-b7d5-18cc075fff16 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:15.728309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1008/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:15.744729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d744-7859-4de1-b80c-f20162dd0e10 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.744979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d744-7859-4de1-b80c-f20162dd0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.745189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2d744-7859-4de1-b80c-f20162dd0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.798660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d5c2d744-7859-4de1-b80c-f20162dd0e10 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:15.801379 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d5c2d744-7859-4de1-b80c-f20162dd0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.816466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:15.818824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1009/1998] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:15.822511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:15.827244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.827533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.830547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.855563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 990/1999] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:15.886587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:15.890413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:15.921828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:15.923315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1010/2000] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:15.937310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690cca-8be9-472a-95e7-584f1ec4243c service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:15.953164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:15.953932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:15.954963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:15.956274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:15.957134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:15.957449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:15.977901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.027015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 991/2001] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:16.030206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.044734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c8af-1a7e-4074-bbd8-f7ca5e6e8143 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.057809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.058987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.058987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.059157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.059714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.067472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.137771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1011/2002] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:16 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:16.142448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.169074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888335-56ce-4d65-a202-6de729dacb5e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.301248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.303267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.303267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.303585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.306272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.308273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.353084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:16.365913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 992/2003] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:16 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:16.371913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.389118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc616c-33a3-4d3f-965d-dc5848aa9ee8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.398797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.405360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:16.424492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.425301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.425591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.425874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.429498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.447655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.447805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7195-a394-451c-864b-701647aeef30 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.462034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.463173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.463799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.463925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] PATH_INFO: `/v3/projects/559bfc88013b4dfea8699360696673b0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.465641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] RBAC: Authorizing `identity:delete_project(project_id=559bfc88013b4dfea8699360696673b0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.470677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1012/2004] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:16.471952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.475587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.496149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fad47-0900-49f1-9632-206831a5e515 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.505883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.506521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.506809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.507106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.507768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.509376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.523000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1013/2005] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:16.528676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.541482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e06d-4d64-4e5b-a082-ba1d715b3a40 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.547335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559bfc88013b4dfea8699360696673b0', 'request_id': 'req-b3d33aa3-bddb-4028-8957-2778d4d3834c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.559373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559bfc88013b4dfea8699360696673b0', 'request_id': 'req-b3d33aa3-bddb-4028-8957-2778d4d3834c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.571829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559bfc88013b4dfea8699360696673b0', 'request_id': 'req-b3d33aa3-bddb-4028-8957-2778d4d3834c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.598642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] The token cache is being invalidate because project 559bfc88013b4dfea8699360696673b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:16.598943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.600982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.606131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 993/2006] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:16 2022] DELETE /identity/v3/projects/559bfc88013b4dfea8699360696673b0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:16.606131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.607174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:16.629619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.630720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.631371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.631371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] PATH_INFO: `/v3/projects/f9c376d633964c57956032593c5cec7c/users/42f5744f169b45849274320af8a2dfcf/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.652130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c376d633964c57956032593c5cec7c, user_id=42f5744f169b45849274320af8a2dfcf, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.655129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.675611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1014/2007] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:16 2022] PUT /identity/v3/projects/f9c376d633964c57956032593c5cec7c/users/42f5744f169b45849274320af8a2dfcf/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:16.676473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:16.678124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:16.701771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33aa3-bddb-4028-8957-2778d4d3834c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.774552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955543a-52dc-46b9-a80f-139419500ef2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:16.780563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.781398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.781760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.782114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] PATH_INFO: `/v3/users/0c673655a3aa4839a0397c2261a4df56` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.784782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c673655a3aa4839a0397c2261a4df56)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.788890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.795043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:16.795968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.796325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.796606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] PATH_INFO: `/v3/projects/22d7d948ebd1495591702dd7eda33e8d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.798188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d7d948ebd1495591702dd7eda33e8d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:16.801482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:16.847903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:16.863673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:16.869894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d7d948ebd1495591702dd7eda33e8d', 'request_id': 'req-16ae6a87-d744-4afb-908d-0ff88592d245'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.892056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d7d948ebd1495591702dd7eda33e8d', 'request_id': 'req-16ae6a87-d744-4afb-908d-0ff88592d245'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.900607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d7d948ebd1495591702dd7eda33e8d', 'request_id': 'req-16ae6a87-d744-4afb-908d-0ff88592d245'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.915178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] The token cache is being invalidate because project 22d7d948ebd1495591702dd7eda33e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:16.916085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.916778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-16ae6a87-d744-4afb-908d-0ff88592d245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.923683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 994/2008] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:16 2022] DELETE /identity/v3/projects/22d7d948ebd1495591702dd7eda33e8d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:16.925025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.925312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.925589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:16.925956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c673655a3aa4839a0397c2261a4df56'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.947006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c673655a3aa4839a0397c2261a4df56'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.947860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c673655a3aa4839a0397c2261a4df56'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.948573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c673655a3aa4839a0397c2261a4df56'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.962103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] MFA Rules not processed for user `42f5744f169b45849274320af8a2dfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:16.963364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:16.964428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9da15427-3ac0-488b-a8ff-da0ccbe9cfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c673655a3aa4839a0397c2261a4df56'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:16.978831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1015/2009] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:16 2022] DELETE /identity/v3/users/0c673655a3aa4839a0397c2261a4df56 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:16.980384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48916-cfcc-4418-9f98-023880159e90 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:16.980772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48916-cfcc-4418-9f98-023880159e90 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:16.981151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48916-cfcc-4418-9f98-023880159e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.005175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-19b48916-cfcc-4418-9f98-023880159e90 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:17.006895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-19b48916-cfcc-4418-9f98-023880159e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.075877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 995/2010] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:17.080386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.082179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.098421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1016/2011] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:17.122050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.122540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.123153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.146590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:17.148325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.160373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1017/2012] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:17.164587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.178936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365ab80-0cd6-40de-9274-774776f8d501 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.182996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5d1a-dfb8-41ff-87d7-8a4c3046b6b1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.184600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.185492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.185923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.186433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.187271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:17.188298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.190287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.191797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.192547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.192971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.193325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.195329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.197963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.207840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1018/2013] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:17.212530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.229474 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3648e-c12b-4b63-ac0e-0ee5a08d090d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.241195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.242383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.243356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.243927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.245316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.251546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.252563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 996/2014] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:17.257611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.302960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1019/2015] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:17.303838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.352553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:17.402041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03f7f-9ef3-4497-873d-e0ef07aac870 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.435272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.437026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.437689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.438281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.439429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.442552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.447626 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d974e-59e0-491b-900a-907e55962a72 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.464323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.465013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.465644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.466166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.466857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.470933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:17.474994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.500555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1020/2016] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:17.501821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.504685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.522814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 997/2017] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:17.523682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.526614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd086012-e3d3-4070-976f-b1a6ffd46ea4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.534588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.535878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.536168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.536445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] PATH_INFO: `/v3/projects/317cae941c0648fb8da7b03bf2ebd323` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.538184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=317cae941c0648fb8da7b03bf2ebd323)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.541018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3f303-4288-428d-a033-15c9438d7324 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.541172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.546571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.547345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.547877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.548191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.548898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.550559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.563085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 998/2018] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:17.566869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.580629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4ba94-b07c-449b-8cf5-5d085ce423bd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.595807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.596566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.596916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.597195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.597996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.602309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.616503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 999/2019] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:17.617457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.645065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317cae941c0648fb8da7b03bf2ebd323', 'request_id': 'req-0e0f9608-9ede-4e2a-ade4-890f09777fde'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:17.650686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6e9e5-c7dd-4669-b5c3-7e28414f0ae0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.653587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317cae941c0648fb8da7b03bf2ebd323', 'request_id': 'req-0e0f9608-9ede-4e2a-ade4-890f09777fde'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:17.664635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317cae941c0648fb8da7b03bf2ebd323', 'request_id': 'req-0e0f9608-9ede-4e2a-ade4-890f09777fde'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:17.682093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] The token cache is being invalidate because project 317cae941c0648fb8da7b03bf2ebd323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:17.682401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:17.683441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:17.685167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1021/2020] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:17 2022] DELETE /identity/v3/projects/317cae941c0648fb8da7b03bf2ebd323 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:17.690685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.692230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.788105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.789014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.790316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.790316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.790855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.792775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3109-abf6-4819-bdcd-7633298efba7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.796520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9608-9ede-4e2a-ade4-890f09777fde admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.806750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1000/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:17.808320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.808778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.809086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.809438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.810286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.811523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.812202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] PATH_INFO: `/v3/projects/6254f5a9a8b8424596898f276ce6f98d/users/5eabe263916c4f84bb0f8ba4ef0ba2b5/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.836368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:17.837911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.845704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6254f5a9a8b8424596898f276ce6f98d, user_id=5eabe263916c4f84bb0f8ba4ef0ba2b5, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:17.855262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:17.855411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1001/2022] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:17.855411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.855411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.873545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcb58b-15a4-421a-9ab6-718158dc895a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:17.879924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1022/2023] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:17 2022] PUT /identity/v3/projects/6254f5a9a8b8424596898f276ce6f98d/users/5eabe263916c4f84bb0f8ba4ef0ba2b5/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:17.879924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:17.880736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:17.987165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:17.987953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:17.988335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:17.988764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] PATH_INFO: `/v3/projects/95db2d81779144fda20d352526543edb/users/98353f5c78634ae08f1479cca4317818/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:17.994689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:18.003450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981267-74c7-4405-8cbe-9f0b72f671f7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.010845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.013136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.013758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.014148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] PATH_INFO: `/v3/users/1ebd9bada7e8444a91ceaafa54c2ca02` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.015820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebd9bada7e8444a91ceaafa54c2ca02)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.019534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.029353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95db2d81779144fda20d352526543edb, user_id=98353f5c78634ae08f1479cca4317818, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.032344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e41735-7d0a-405b-abf3-ad947ced5303 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.060422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1002/2024] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:17 2022] PUT /identity/v3/projects/95db2d81779144fda20d352526543edb/users/98353f5c78634ae08f1479cca4317818/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:18.061951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3388-6738-43d8-af77-030f29882bc6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.062192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3388-6738-43d8-af77-030f29882bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.062487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3388-6738-43d8-af77-030f29882bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.104062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2e9b3388-6738-43d8-af77-030f29882bc6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:18.105285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2e9b3388-6738-43d8-af77-030f29882bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.120096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebd9bada7e8444a91ceaafa54c2ca02'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:18.135224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:18.136903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebd9bada7e8444a91ceaafa54c2ca02'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:18.137702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebd9bada7e8444a91ceaafa54c2ca02'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:18.138378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebd9bada7e8444a91ceaafa54c2ca02'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:18.166080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebd9bada7e8444a91ceaafa54c2ca02'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:18.198094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1023/2025] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:17 2022] DELETE /identity/v3/users/1ebd9bada7e8444a91ceaafa54c2ca02 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:18.199462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.201605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.229103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1003/2026] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:18.231017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a9282-9961-4a51-9563-3142df178795 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.231406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a9282-9961-4a51-9563-3142df178795 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.231963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a9282-9961-4a51-9563-3142df178795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.292685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f06a9282-9961-4a51-9563-3142df178795 None None] MFA Rules not processed for user `98353f5c78634ae08f1479cca4317818`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:18.300556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f06a9282-9961-4a51-9563-3142df178795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.307255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9fff-a4b3-49b4-bbfb-52cbd4db03fe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.313536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.314374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.314832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.315267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.315859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.317532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dff6c-8aa3-4f4f-9b0b-880ea07b804e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.328851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1024/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:18.330107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.330395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.331352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.352087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:18.353210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.365495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1025/2028] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:18.365495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.390947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d82f-138e-40e9-a806-6d75edacd36c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.401715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.403821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.406956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.408868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.409869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:18.410278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.412927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.427055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1004/2029] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:18.427055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a9282-9961-4a51-9563-3142df178795 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.442212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a9282-9961-4a51-9563-3142df178795 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.445393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1026/2030] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:18.449685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.451574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.454838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.455958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.456349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.456783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] PATH_INFO: `/v3/projects/6254f5a9a8b8424596898f276ce6f98d/users/5eabe263916c4f84bb0f8ba4ef0ba2b5/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.460307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6254f5a9a8b8424596898f276ce6f98d, user_id=5eabe263916c4f84bb0f8ba4ef0ba2b5, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.462499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.477003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1005/2031] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:18 2022] PUT /identity/v3/projects/6254f5a9a8b8424596898f276ce6f98d/users/5eabe263916c4f84bb0f8ba4ef0ba2b5/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:18.488144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.490599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.548909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003c91-571c-4418-9142-b0e486ff85e8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.557048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:18.587795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3232c-521f-4635-bfc9-13fa148bf590 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.591840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.592620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.593005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.593434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.613883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.614548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.615136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.615657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.629520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:18.669871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.672144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.686584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1006/2032] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:18.687867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.689097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.690588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923154-f9e4-4e7e-b762-0abfc69c60e2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.700769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1027/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:18.705708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0753e-15ee-409f-96ad-baf93d9c390b service glance] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.710381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.710722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.711062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.712974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.713804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.714050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.714326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.716764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.720471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.757816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] MFA Rules not processed for user `5eabe263916c4f84bb0f8ba4ef0ba2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:18.759792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:18.760623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1007/2034] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:18.768108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.862422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3ae3-afeb-40fe-b649-8c3b681ea393 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.871168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.871892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.872415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.872901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.873526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.876526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.912636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1028/2035] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:18.916865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1008/2036] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:18 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:18.918499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.940823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07afaca-6ed7-406a-b64c-983ebb3a35ba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.946549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.947463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.947749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.948025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.948828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.950590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:18.963107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1029/2037] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:18.967469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:18.978880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466155-b558-4ebf-a7f9-a5d6320f1232 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:18.985240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:18.985575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:18.985857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:18.986135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:18.986839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:18.988635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.003340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1009/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:19.008540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.023452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9420f5-dbb6-491b-9e26-c3cb0911b357 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.034027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.035354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.035644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.036019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] PATH_INFO: `/v3/projects/a00c67e58d5243d78ed4c4f5666994ba/users/92c842e2e4804f038898cd70dbf40ae2/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.055512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00c67e58d5243d78ed4c4f5666994ba, user_id=92c842e2e4804f038898cd70dbf40ae2, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.058333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc4d2f-7627-4f80-b635-ff0a1e708d54 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.098964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.102005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.119177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1030/2039] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:19 2022] PUT /identity/v3/projects/a00c67e58d5243d78ed4c4f5666994ba/users/92c842e2e4804f038898cd70dbf40ae2/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:19.124539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.125711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.126069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.155258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:19.191104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0aef-eec0-4e75-ae71-686c2ff7f1cb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.195977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] MFA Rules not processed for user `92c842e2e4804f038898cd70dbf40ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:19.197066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.277852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:19.305650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1031/2040] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:19.309974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.312068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.313218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.314262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.314844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.452007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dd92-5e5e-4349-8404-4366274059d8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.459339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.460868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.476465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.478873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.479262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.479610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.480809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.483660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.484930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1010/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:19.486015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.487678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.504593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a3fcc-d4f9-4280-8cfb-4733b4df4760 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.532154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.532941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.533295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.533643 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] PATH_INFO: `/v3/projects/b00aa31ce1d540d7bcc0a8e49cee54d2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.535006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00aa31ce1d540d7bcc0a8e49cee54d2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.537111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.537280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1032/2042] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:19 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:19.539966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.649079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00aa31ce1d540d7bcc0a8e49cee54d2', 'request_id': 'req-fec30225-b8ba-413d-8662-375fec346bda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.672191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00aa31ce1d540d7bcc0a8e49cee54d2', 'request_id': 'req-fec30225-b8ba-413d-8662-375fec346bda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.684144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d9ba-0529-4acb-8603-27642674230b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.685014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00aa31ce1d540d7bcc0a8e49cee54d2', 'request_id': 'req-fec30225-b8ba-413d-8662-375fec346bda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.706863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] The token cache is being invalidate because project b00aa31ce1d540d7bcc0a8e49cee54d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:19.707206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.708044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.710046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1011/2043] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:19 2022] DELETE /identity/v3/projects/b00aa31ce1d540d7bcc0a8e49cee54d2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:19.711546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.713666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.747365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:19.784245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.785103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.785539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.786038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.787054 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.789022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.792650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30225-b8ba-413d-8662-375fec346bda admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.798400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.799073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.799384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.799656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.801384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.825960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1033/2044] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:19 2022] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:19.826854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.829129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.833842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:19.842904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9059533-0190-4b61-9ec9-fe100db9e016 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.849076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.849807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.850122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.850407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] PATH_INFO: `/v3/users/b6deab8bd6314789b7eac54a4daaf3f1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.852368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6deab8bd6314789b7eac54a4daaf3f1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.854575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.873077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.875502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.887268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1012/2045] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:19.889328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.892934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.909819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8109011-d814-42d0-81db-40e568e7b717 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:19.915194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:19.915789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:19.916068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:19.916340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] PATH_INFO: `/v3/users/525cdd48790b4cb39d63eda95f705503` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:19.916436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6deab8bd6314789b7eac54a4daaf3f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.918576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525cdd48790b4cb39d63eda95f705503)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:19.919991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:19.925666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6deab8bd6314789b7eac54a4daaf3f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.927549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6deab8bd6314789b7eac54a4daaf3f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.927549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6deab8bd6314789b7eac54a4daaf3f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.951131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6deab8bd6314789b7eac54a4daaf3f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:19.971846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1034/2046] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:19 2022] DELETE /identity/v3/users/b6deab8bd6314789b7eac54a4daaf3f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:19.972978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:19.974377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:19.999283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525cdd48790b4cb39d63eda95f705503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.012385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525cdd48790b4cb39d63eda95f705503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.015323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525cdd48790b4cb39d63eda95f705503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.017466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525cdd48790b4cb39d63eda95f705503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.030104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-490def34-5a3b-4f06-8c13-b0d3204cc086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525cdd48790b4cb39d63eda95f705503'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.075832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670fcf7-6911-423a-9459-d4ce626dae88 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.083071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1013/2047] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:19 2022] DELETE /identity/v3/users/525cdd48790b4cb39d63eda95f705503 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:20.087293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.088738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.090376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.096578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.097432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.097560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.097751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.098414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.101021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.130362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:20.131674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.134185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1035/2048] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:20.138576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.142060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.162318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13f2c-dd6f-4214-b75a-301fb30167e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.192555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:20.240679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1014/2049] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:20.251515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.253677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.257008 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.258234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.258728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.259219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] PATH_INFO: `/v3/projects/b795d50d55bd412d809b1dbabb90e978/users/90eb4d8143b2440ba9aa2332a64234bf/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.282061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b795d50d55bd412d809b1dbabb90e978, user_id=90eb4d8143b2440ba9aa2332a64234bf, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.285542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.329333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1036/2050] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:20 2022] PUT /identity/v3/projects/b795d50d55bd412d809b1dbabb90e978/users/90eb4d8143b2440ba9aa2332a64234bf/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:20.332333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.334789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:20.368379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b41ba-1480-444d-85cd-aa2fb34e9d75 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.460325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.460987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.461214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.461489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.464496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18fe6-f413-4424-8b53-4c7369f5ad31 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.469646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.470424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.470712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.470986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.471821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.473425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.473622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.475072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.485836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1037/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:20.486230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1015/2052] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:20.486883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.488426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.492282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.502389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379a284-00d3-4255-99d6-da8a94ae52a4 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.505182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9fd9-7b68-408f-9777-00dcd56fd12c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.507992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.508689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.509045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.509390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] PATH_INFO: `/v3/projects/58b2c144b72540d0b8275fa536ff9a4b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.510209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.510989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.511505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.511896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] PATH_INFO: `/v3/projects/b795d50d55bd412d809b1dbabb90e978/users/90eb4d8143b2440ba9aa2332a64234bf/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.512500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b2c144b72540d0b8275fa536ff9a4b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.513915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b795d50d55bd412d809b1dbabb90e978, user_id=90eb4d8143b2440ba9aa2332a64234bf, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.514967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.517821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a166e-3461-4f13-91bf-70ba36e724c1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.548047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1038/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:20 2022] PUT /identity/v3/projects/b795d50d55bd412d809b1dbabb90e978/users/90eb4d8143b2440ba9aa2332a64234bf/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:20.581865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.582178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.586506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.628142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b2c144b72540d0b8275fa536ff9a4b', 'request_id': 'req-02d692ed-d75a-4533-ba96-096eb69312de'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.642978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b2c144b72540d0b8275fa536ff9a4b', 'request_id': 'req-02d692ed-d75a-4533-ba96-096eb69312de'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.655822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b2c144b72540d0b8275fa536ff9a4b', 'request_id': 'req-02d692ed-d75a-4533-ba96-096eb69312de'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.661263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] MFA Rules not processed for user `90eb4d8143b2440ba9aa2332a64234bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:20.663131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.685274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] The token cache is being invalidate because project 58b2c144b72540d0b8275fa536ff9a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:20.685735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.688129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02d692ed-d75a-4533-ba96-096eb69312de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:20.694857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1016/2054] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:20 2022] DELETE /identity/v3/projects/58b2c144b72540d0b8275fa536ff9a4b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:20.699687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef468-d7d9-466f-9c2d-6013fdaf1fcf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.700598 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef468-d7d9-466f-9c2d-6013fdaf1fcf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.715254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef468-d7d9-466f-9c2d-6013fdaf1fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.739700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0cfef468-d7d9-466f-9c2d-6013fdaf1fcf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:20.741050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0cfef468-d7d9-466f-9c2d-6013fdaf1fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.811986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1039/2055] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:20.825040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.826509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.832011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1017/2056] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:20.839586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.840476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.840949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.880540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:20.883604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:20.885468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:20.897312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1018/2057] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:20.902437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.914738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ce5d7-92d7-407f-a445-6ed4afb7fbcc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.920044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.920772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.921017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.921293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.922757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:20.923099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.924946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:20.945763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1019/2058] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:20.949140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:20.960549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:20.963809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958e6e-a85d-47ee-9eba-9ba6436c9dcc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:20.971704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:20.972512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:20.973162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:20.974152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:20.974668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:20.977055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.015430 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98d8a-a4bc-4dc3-bbb5-72ffd243de2c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.020206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.020835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.021353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.021634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.027080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1020/2059] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:20 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:21.028974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.052626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.056439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.101602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1040/2060] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:21.102715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.104329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:21.133399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4733d1-3000-471b-ab40-4b2b12dc963f service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.175003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2772-ea31-4879-8007-1edc09624db3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.200766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.201522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.201877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.202241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.203057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.205401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.248744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.249422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.249873 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.250184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] PATH_INFO: `/v3/projects/98446d2ca3a9415e9a7d825d27be0186` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.251505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98446d2ca3a9415e9a7d825d27be0186)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.253721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.282074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1021/2061] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:21 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:21.286195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.299928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40debc9-8578-4e1e-ab49-d3f4e3db4499 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.309066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.309956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.310308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.310836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.312214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.316322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.342054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1022/2062] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:21.342981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.355202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74147208-df57-4058-8fe5-d1b3fce1c609 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.357460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98446d2ca3a9415e9a7d825d27be0186', 'request_id': 'req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.372691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98446d2ca3a9415e9a7d825d27be0186', 'request_id': 'req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.383797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98446d2ca3a9415e9a7d825d27be0186', 'request_id': 'req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.399254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] The token cache is being invalidate because project 98446d2ca3a9415e9a7d825d27be0186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:21.399621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.400280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.402075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1041/2063] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:21 2022] DELETE /identity/v3/projects/98446d2ca3a9415e9a7d825d27be0186 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:21.405892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.407930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:21.471407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.473694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.475315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.475687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.476929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.481094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.488344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:21.514497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bf9f-a3e0-4c6e-8910-4cc45a43bac6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.517994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1023/2064] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:21.519518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.522032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:21.528630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.529584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.529971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.530365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] PATH_INFO: `/v3/users/f4be453a445843369fb6df46a407cccd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.532575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4be453a445843369fb6df46a407cccd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.534998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.537574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad098f-5ec5-45c3-90d3-5e0b0803b52e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.546362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.547169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.547452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.547732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] PATH_INFO: `/v3/projects/56df8c20a4504100b2784c6c694af845/users/4347a470a016477facc122c4c21f9820/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.564934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56df8c20a4504100b2784c6c694af845, user_id=4347a470a016477facc122c4c21f9820, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:21.568101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19388ecf-6720-4265-af9e-0bb44498e9f2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:21.634589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1024/2065] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:21 2022] PUT /identity/v3/projects/56df8c20a4504100b2784c6c694af845/users/4347a470a016477facc122c4c21f9820/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:21.639539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4be453a445843369fb6df46a407cccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.641963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.642612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.643114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:21.667671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4be453a445843369fb6df46a407cccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.669120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4be453a445843369fb6df46a407cccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.672161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4be453a445843369fb6df46a407cccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.675589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:21.676881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:21.717750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4be453a445843369fb6df46a407cccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:21.719744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:21.749164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1042/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:21 2022] DELETE /identity/v3/users/f4be453a445843369fb6df46a407cccd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:21.780726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1025/2067] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:21.801987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:21.803852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:21.922545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743dfec-1108-40bd-8e82-950320960e0d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:21.940656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:21.943281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:21.943281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:21.943281 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.053852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:22.055495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:22.072175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1043/2068] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:22.172232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:22.173380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:22.203649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8394-ffc3-406b-9134-fc5e9b3bc599 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:22.217721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:22.220541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:22.220995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:22.221418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] PATH_INFO: `/v3/projects/8059cc970ad14a80b51b007f634c6166` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.225319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8059cc970ad14a80b51b007f634c6166)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:22.228289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:22.330519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8059cc970ad14a80b51b007f634c6166', 'request_id': 'req-c684b66e-43cb-4e30-9071-02cd040d22e6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.341411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8059cc970ad14a80b51b007f634c6166', 'request_id': 'req-c684b66e-43cb-4e30-9071-02cd040d22e6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.352849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8059cc970ad14a80b51b007f634c6166', 'request_id': 'req-c684b66e-43cb-4e30-9071-02cd040d22e6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.375717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] The token cache is being invalidate because project 8059cc970ad14a80b51b007f634c6166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:22.376104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.377174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.379640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1026/2069] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:22 2022] DELETE /identity/v3/projects/8059cc970ad14a80b51b007f634c6166 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:22.383562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:22.398053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff593-9e03-40ba-a655-f733dfd798aa service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:22.436226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:22.501921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:22.502757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:22.503140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:22.503526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] PATH_INFO: `/v3/users/375164c9218d400ead9516b682271218` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.505373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375164c9218d400ead9516b682271218)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:22.508198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:22.542967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:22.544976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:22.560698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b66e-43cb-4e30-9071-02cd040d22e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:22.566980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:22.567763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:22.568114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:22.568461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] PATH_INFO: `/v3/users/92c842e2e4804f038898cd70dbf40ae2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.569725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c842e2e4804f038898cd70dbf40ae2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:22.571896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375164c9218d400ead9516b682271218'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.572446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:22.583443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375164c9218d400ead9516b682271218'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.584337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375164c9218d400ead9516b682271218'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.586950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375164c9218d400ead9516b682271218'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.604890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc1df164-34c7-4182-9f25-5920e220e1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375164c9218d400ead9516b682271218'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.621210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1044/2070] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:22 2022] DELETE /identity/v3/users/375164c9218d400ead9516b682271218 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:22.634953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c842e2e4804f038898cd70dbf40ae2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.644805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c842e2e4804f038898cd70dbf40ae2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.645830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c842e2e4804f038898cd70dbf40ae2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.646812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c842e2e4804f038898cd70dbf40ae2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.656892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c842e2e4804f038898cd70dbf40ae2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:22.691322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1027/2071] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:22 2022] DELETE /identity/v3/users/92c842e2e4804f038898cd70dbf40ae2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:22.695893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:22.696299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:22.696691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.730557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:22.732049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:22.819311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1045/2072] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:22.838917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:22.841825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:22.900165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:22.953497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72215bf-c973-48b8-a6c3-023df40373c0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:22.957695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:22.958655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:22.958655 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:22.958985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:22.986210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:22.989621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408cb8-99c8-45bf-887e-033db800d7b2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.004658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.006062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:23.006647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1028/2073] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:23.018487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8e62-b80e-43d1-bba7-2f4243b15f4a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.028059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.028730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.029009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.029278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] PATH_INFO: `/v3/projects/5d3648eb9cce439394f20ace4fae8bbb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.030716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3648eb9cce439394f20ace4fae8bbb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.033762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.090465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:23.104267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3648eb9cce439394f20ace4fae8bbb', 'request_id': 'req-6140a049-3187-4d40-a8ab-4e9cfe140677'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:23.112893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3648eb9cce439394f20ace4fae8bbb', 'request_id': 'req-6140a049-3187-4d40-a8ab-4e9cfe140677'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:23.130433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3648eb9cce439394f20ace4fae8bbb', 'request_id': 'req-6140a049-3187-4d40-a8ab-4e9cfe140677'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:23.152251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] The token cache is being invalidate because project 5d3648eb9cce439394f20ace4fae8bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:23.152686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:23.153973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6140a049-3187-4d40-a8ab-4e9cfe140677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:23.156831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1046/2074] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:23 2022] DELETE /identity/v3/projects/5d3648eb9cce439394f20ace4fae8bbb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:23.164201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.164495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.165069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.193765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:23.195426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:23.283689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1029/2075] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:23.292905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.293204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.293486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.318663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:23.319933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:23.329241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1047/2076] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:23.333341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.344410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc337cf-a659-4e82-a4e5-4cee8cf63e76 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.349439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.350093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.350548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.350918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.351787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:23.352733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.354668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.400884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1030/2077] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:23.406196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.415982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4092d-6f36-4dfa-bfd7-957f59ed5c95 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.429250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.430109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.430463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.430802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.431740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.434560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.493406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1048/2078] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:23 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:23.497959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.513421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6bf64-5511-464b-85a3-28b9a53be454 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.699866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.702050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.703762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.704602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.705529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.708209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e537e-05f3-4d80-8fe6-b9839a6d4d50 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.765340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1031/2079] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:23 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:23.769866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.789122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.789122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.789122 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.792962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecf32-13c9-4310-97e9-b56a0d0c55ae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.831208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.833035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.833292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.834184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.834876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.839911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.854939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1049/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:23.858435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:23.886340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] MFA Rules not processed for user `4347a470a016477facc122c4c21f9820`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:23.887703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:23.941632 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6336ffe-d508-4510-ac44-501c79c6dd40 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:23.976882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:23.977519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:23.977773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:23.986084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:23.986900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:23.994364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:23.999260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:24.044551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1050/2081] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:24.044551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.045973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.061461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6804b6-18c0-49c6-aec5-bfd3e02982ec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.067732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.068518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.068899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.069291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] PATH_INFO: `/v3/projects/a00c67e58d5243d78ed4c4f5666994ba` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.070912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00c67e58d5243d78ed4c4f5666994ba)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.075202 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.115115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1032/2082] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:24.118448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.148787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75925-0859-4e78-85b7-2f63f26a0164 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.162647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.163375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.163642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.163915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] PATH_INFO: `/v3/projects/a81eb237017f451eb4636112f8e4de9e/users/f70d6c4dc3d54eb7960babd0dda1b678/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.185335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00c67e58d5243d78ed4c4f5666994ba', 'request_id': 'req-60ff9111-9f7e-4326-97df-d113685f1ef7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.195212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00c67e58d5243d78ed4c4f5666994ba', 'request_id': 'req-60ff9111-9f7e-4326-97df-d113685f1ef7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.203083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81eb237017f451eb4636112f8e4de9e, user_id=f70d6c4dc3d54eb7960babd0dda1b678, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.205255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00c67e58d5243d78ed4c4f5666994ba', 'request_id': 'req-60ff9111-9f7e-4326-97df-d113685f1ef7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.214765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.226306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] The token cache is being invalidate because project a00c67e58d5243d78ed4c4f5666994ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:24.226603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.227310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.233364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1051/2083] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:24 2022] DELETE /identity/v3/projects/a00c67e58d5243d78ed4c4f5666994ba => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:24.233364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.235389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.245429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1033/2084] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:24 2022] PUT /identity/v3/projects/a81eb237017f451eb4636112f8e4de9e/users/f70d6c4dc3d54eb7960babd0dda1b678/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:24.247387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.252309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.330554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:24.336638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9111-9f7e-4326-97df-d113685f1ef7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.401834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a5ca-8a99-4100-9ceb-6064d5af8e85 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.409426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.409810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.414709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.415071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] PATH_INFO: `/v3/users/90eb4d8143b2440ba9aa2332a64234bf` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.416566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90eb4d8143b2440ba9aa2332a64234bf)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.418842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.462834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.463727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.463727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.464043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.464710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.466845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3762-3d7e-4740-bac8-421d0f999306 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.512167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1052/2085] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:24 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:24.514114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.514402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.514728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.515974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90eb4d8143b2440ba9aa2332a64234bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.526016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90eb4d8143b2440ba9aa2332a64234bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.527166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90eb4d8143b2440ba9aa2332a64234bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.528105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90eb4d8143b2440ba9aa2332a64234bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.538392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90eb4d8143b2440ba9aa2332a64234bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.561427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1034/2086] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:24 2022] DELETE /identity/v3/users/90eb4d8143b2440ba9aa2332a64234bf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:24.562627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.571424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.595915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] MFA Rules not processed for user `f70d6c4dc3d54eb7960babd0dda1b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:24.600658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.657068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:24.726651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264f380-8294-4eed-9d65-cf2b21da10d2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.742433 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.742705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.743267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.743539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] PATH_INFO: `/v3/users/42f5744f169b45849274320af8a2dfcf` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.745373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f5744f169b45849274320af8a2dfcf)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.752630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1053/2087] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:24.752630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.752914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.753777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.805999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeb096-8133-4b17-a664-728356eaed67 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.812654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.815165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.815165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.815165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.815570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.817717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.854957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1054/2088] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:24 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:24.855927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.857685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.865179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f5744f169b45849274320af8a2dfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.884028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746dc5-cdc8-4203-ae92-53c7a6dba70b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:24.884964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f5744f169b45849274320af8a2dfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.885885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f5744f169b45849274320af8a2dfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.889765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f5744f169b45849274320af8a2dfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.891673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:24.892845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.893173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.893455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.894935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:24.898158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ff8c3-3ff0-4e85-a610-b52b28221602 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:24.902600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f5744f169b45849274320af8a2dfcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:24.937091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1035/2089] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:24 2022] DELETE /identity/v3/users/42f5744f169b45849274320af8a2dfcf => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:24.938801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:24.940488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:24.963508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1055/2090] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:24 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:24.964851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:24.965142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:24.965405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:24.992024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:24.993248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.076996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:25.119586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1056/2091] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:25.122800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.122800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.148803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af5db-8101-4607-9010-9d1bedd0514c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.155332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55dd0a-b48a-4a86-8ee4-7a5a5fa66376 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.160591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.161220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.161499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.161865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.162371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.162526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.163338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.164205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.164574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.165300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.165416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.167615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.194348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1036/2092] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:25.195398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.216369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.219859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1057/2093] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:25 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:25.221714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.223921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.231324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c8f1-c434-4d4c-8601-51ff40da452a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.237457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.238200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.238550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.238903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] PATH_INFO: `/v3/projects/b795d50d55bd412d809b1dbabb90e978` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.240317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b795d50d55bd412d809b1dbabb90e978)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.242393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.315922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:25.329387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b795d50d55bd412d809b1dbabb90e978', 'request_id': 'req-ba06cde5-570f-406f-b323-e653d5efdd9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:25.341277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e6ae2-910e-4d05-a646-44fe87aa1b75 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.354970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b795d50d55bd412d809b1dbabb90e978', 'request_id': 'req-ba06cde5-570f-406f-b323-e653d5efdd9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:25.365978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b795d50d55bd412d809b1dbabb90e978', 'request_id': 'req-ba06cde5-570f-406f-b323-e653d5efdd9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:25.412300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] The token cache is being invalidate because project b795d50d55bd412d809b1dbabb90e978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:25.412604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:25.413343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:25.414923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1037/2094] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:25 2022] DELETE /identity/v3/projects/b795d50d55bd412d809b1dbabb90e978 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:25.418383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.419456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.438077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.438850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.439267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.439642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.442386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.506179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06cde5-570f-406f-b323-e653d5efdd9e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.511089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.511827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.512185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.512527 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] PATH_INFO: `/v3/projects/053ec91d00d64958815b5839ba07113e/users/e7bf6c9cdb9e497a82a870476c28e075/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.516696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.518251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.527778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053ec91d00d64958815b5839ba07113e, user_id=e7bf6c9cdb9e497a82a870476c28e075, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.529175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1058/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:25.530570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d63ed-9b8e-46cc-bbb0-9ec445385588 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.536204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.537935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.555716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1038/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:25 2022] PUT /identity/v3/projects/053ec91d00d64958815b5839ba07113e/users/e7bf6c9cdb9e497a82a870476c28e075/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:25.555918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c338b-e20d-482d-98d7-363dc5575a21 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.556867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.557200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.557416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.581697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:25.582937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.591680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:25.647079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.647705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.647990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.648259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.650034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.651725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.669606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1059/2097] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:25.670499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.684102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1039/2098] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:25.685216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.687928 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea87e1-e457-427f-9174-1e403b9b480a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.694842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.696291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db305f44-01cf-4bd0-9180-d00d32a7a814 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.701460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.702071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.702352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.702625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.703389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.703883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.704459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.704953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.705926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.706205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07feac-4a0b-4b30-94a9-fd153ef5b60e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.708824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.724827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1040/2099] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:25.728505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.729532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.729967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.733405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1060/2100] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:25.735128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.755916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc17fc-5c98-4c0c-8c61-7e0f4341bcc1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.768215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:25.770563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.780429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.781667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.781948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.782222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] PATH_INFO: `/v3/projects/761f3d0c7a864b769b8408bfd8cc75ff/users/dad0e07f572c4af3b6365ca697390e2b/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.799828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1041/2101] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:25.799828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.803268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761f3d0c7a864b769b8408bfd8cc75ff, user_id=dad0e07f572c4af3b6365ca697390e2b, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.806820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.810026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a1f8-b433-45e4-8739-bce7d4c8b306 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:25.816942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:25.817785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.818191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.818575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] PATH_INFO: `/v3/projects/053ec91d00d64958815b5839ba07113e/users/e7bf6c9cdb9e497a82a870476c28e075/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.821216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053ec91d00d64958815b5839ba07113e, user_id=e7bf6c9cdb9e497a82a870476c28e075, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:25.824287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e60fc-c899-4db3-a728-03fd4c792541 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:25.829858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1061/2102] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:25 2022] PUT /identity/v3/projects/761f3d0c7a864b769b8408bfd8cc75ff/users/dad0e07f572c4af3b6365ca697390e2b/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:25.831016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:25.847466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1042/2103] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:25 2022] PUT /identity/v3/projects/053ec91d00d64958815b5839ba07113e/users/e7bf6c9cdb9e497a82a870476c28e075/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:25.849249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:25.849685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:25.850026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:25.892559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] MFA Rules not processed for user `dad0e07f572c4af3b6365ca697390e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:25.894174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:25.908924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:25.967299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c964cc-d96a-422d-bf84-c364bf6b5139 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.022199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1043/2104] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:26.023149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.025347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.074038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.075117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.076906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.077615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.079258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:26.090445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.094076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.133222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1062/2105] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:26.134351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.150297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f0d51-2ec6-46cc-9fcb-fb17ab523d8c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.153786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5550e5-e29d-4de1-81bc-6379d8d7f6dd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.156546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.157455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.157972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.158504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.159446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.160231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.161175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.161533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.161811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] PATH_INFO: `/v3/projects/f9c376d633964c57956032593c5cec7c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.163052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c376d633964c57956032593c5cec7c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.163427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.165191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.200040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1063/2106] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:26.200040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.208644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:26.239237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c376d633964c57956032593c5cec7c', 'request_id': 'req-3828a7cf-f995-425a-ac9a-213edda5e0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.250237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c376d633964c57956032593c5cec7c', 'request_id': 'req-3828a7cf-f995-425a-ac9a-213edda5e0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.258847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c376d633964c57956032593c5cec7c', 'request_id': 'req-3828a7cf-f995-425a-ac9a-213edda5e0c6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.275290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] The token cache is being invalidate because project f9c376d633964c57956032593c5cec7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:26.276491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.277712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.279853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1044/2107] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:26 2022] DELETE /identity/v3/projects/f9c376d633964c57956032593c5cec7c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:26.280610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.282512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.289057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401224-a9e3-43ca-b752-86a85051b975 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.349832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:26.373954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828a7cf-f995-425a-ac9a-213edda5e0c6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.378737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.379504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.380503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.380917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.381264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.382156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.382416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.382629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.382903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.383614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.384984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.385686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.419261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1045/2108] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:26 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:26.419261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.420585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.434466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016197-06a6-4fac-bbc0-9acafc2598ef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.437685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1064/2109] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:26.442516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.515000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.516698 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.517056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.517395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] PATH_INFO: `/v3/users/5eabe263916c4f84bb0f8ba4ef0ba2b5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.519079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eabe263916c4f84bb0f8ba4ef0ba2b5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.521559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.527197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61841244-0da4-4120-bc42-68e825f17e5e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.534962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.536312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.536592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.536866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.538425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.541076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.561660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1065/2110] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:26.561660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.569233 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.585518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b761-bcf5-4643-828c-615ee5699da7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.591209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.592013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.592340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.592620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.593760 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.596694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.617627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eabe263916c4f84bb0f8ba4ef0ba2b5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.634729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1066/2111] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:26 2022] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:26.634729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.645625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eabe263916c4f84bb0f8ba4ef0ba2b5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.646896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eabe263916c4f84bb0f8ba4ef0ba2b5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.649951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eabe263916c4f84bb0f8ba4ef0ba2b5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.654217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5b56-ef4a-4f2c-bb7f-479c57fcb1b6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.660235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.662145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.662145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.662145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] PATH_INFO: `/v3/projects/e28fd6e691664489b8e1ddf9db54e71c/users/53976be677314e02bb0d5ff1801907d0/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.688214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eabe263916c4f84bb0f8ba4ef0ba2b5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:26.691516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28fd6e691664489b8e1ddf9db54e71c, user_id=53976be677314e02bb0d5ff1801907d0, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.710366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.741586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:26.752295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1067/2112] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:26 2022] PUT /identity/v3/projects/e28fd6e691664489b8e1ddf9db54e71c/users/53976be677314e02bb0d5ff1801907d0/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:26.753295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.756543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1046/2113] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:26 2022] DELETE /identity/v3/users/5eabe263916c4f84bb0f8ba4ef0ba2b5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:26.758368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.761944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.770936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.866129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:26.871191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fbc1f-9635-4dc1-a6ac-ed244a9d9821 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.878158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.878900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.879225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.879822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.880666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.882709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1cec9-c7b1-4ffd-a23c-5e4580fa456b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.891050 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1119a8-08ab-435d-9c4e-214cadc396cc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.897690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1068/2114] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:26.897690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457512-ac97-431f-9c6b-e4257a88e86d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.897690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457512-ac97-431f-9c6b-e4257a88e86d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.897690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457512-ac97-431f-9c6b-e4257a88e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.899018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.899892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.900394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.900811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.901947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.903997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.920400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1047/2115] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:26.922201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.933999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702fea-cd81-4009-bb47-bc838a7fefce admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.940445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.941143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.941528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.941676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-11457512-ac97-431f-9c6b-e4257a88e86d None None] MFA Rules not processed for user `e7bf6c9cdb9e497a82a870476c28e075`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:26.941985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:26.942983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:26.943153 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-11457512-ac97-431f-9c6b-e4257a88e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:26.945222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:26.967880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1048/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:26.968793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:26.990755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7e52-8cb1-4b1f-944d-ef4ce866eea2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:26.997409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:26.998298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:26.998597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:26.998946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] PATH_INFO: `/v3/projects/e28fd6e691664489b8e1ddf9db54e71c/users/53976be677314e02bb0d5ff1801907d0/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.002060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28fd6e691664489b8e1ddf9db54e71c, user_id=53976be677314e02bb0d5ff1801907d0, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.006190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.027934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1049/2117] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:26 2022] PUT /identity/v3/projects/e28fd6e691664489b8e1ddf9db54e71c/users/53976be677314e02bb0d5ff1801907d0/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:27.030867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.064203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1069/2118] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:27.065531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a37d-db3b-4a40-b883-e5f5b470ccc3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.065815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a37d-db3b-4a40-b883-e5f5b470ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.066092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a37d-db3b-4a40-b883-e5f5b470ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.113698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dd12a37d-db3b-4a40-b883-e5f5b470ccc3 None None] MFA Rules not processed for user `53976be677314e02bb0d5ff1801907d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:27.116840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd12a37d-db3b-4a40-b883-e5f5b470ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.139283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7cb75-9de3-4830-b8db-9f152ce27163 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:27.146356 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:27.147264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.147542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.147812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] PATH_INFO: `/v3/projects/62a5adb3629f4034a62cee030343fd03/users/3c83d7bd21b04d4b9c6b208d3defab66/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.183397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a5adb3629f4034a62cee030343fd03, user_id=3c83d7bd21b04d4b9c6b208d3defab66, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.186629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687f089-91bd-4193-bb0e-f85fc4f3d3b6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.207175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1050/2119] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:27 2022] PUT /identity/v3/projects/62a5adb3629f4034a62cee030343fd03/users/3c83d7bd21b04d4b9c6b208d3defab66/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:27.207391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:27.207523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.207523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.207523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.208630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1070/2120] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:27.214788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.215698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.216390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.239347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] MFA Rules not processed for user `4347a470a016477facc122c4c21f9820`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:27.240722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.246703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] MFA Rules not processed for user `3c83d7bd21b04d4b9c6b208d3defab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:27.248079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.344102 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1071/2121] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:27.346869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1051/2122] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:27.348140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.348666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.352088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.357640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.432267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:27.443556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad6566-3aa8-4797-a058-7b89d4a4f6dd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:27.449275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:27.449747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7fa3-e060-4aff-873d-d6d6492eeedf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:27.450260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.450745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.451709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.454597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.455128 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:27.455889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.456242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.456587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] PATH_INFO: `/v3/projects/6254f5a9a8b8424596898f276ce6f98d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.458096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6254f5a9a8b8424596898f276ce6f98d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.460770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.520111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6254f5a9a8b8424596898f276ce6f98d', 'request_id': 'req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:27.530661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6254f5a9a8b8424596898f276ce6f98d', 'request_id': 'req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:27.536655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.538085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.542167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6254f5a9a8b8424596898f276ce6f98d', 'request_id': 'req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:27.547664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1072/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:27.548276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.549664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.568852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] The token cache is being invalidate because project 6254f5a9a8b8424596898f276ce6f98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:27.569293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:27.570298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:27.575721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1052/2124] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:27 2022] DELETE /identity/v3/projects/6254f5a9a8b8424596898f276ce6f98d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:27.575721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.577272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.618689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:27.658139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63e0f-8bcd-4095-b7e4-53fccc51c206 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:27.674749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68e25-ce0b-4517-b4b5-6a55e4ffa19e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:27.679308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:27.679573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.680073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.680431 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.682484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.770143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:27.771510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.772591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.773644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.778021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.782116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.783731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f53f-e0f1-41ca-8294-6488356dff18 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.794770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1053/2125] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:27.796883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49831-5558-4c11-a11a-0e1b3cbcc928 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.797257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49831-5558-4c11-a11a-0e1b3cbcc928 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.797618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49831-5558-4c11-a11a-0e1b3cbcc928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:27.830565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f7e49831-5558-4c11-a11a-0e1b3cbcc928 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:27.831946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f7e49831-5558-4c11-a11a-0e1b3cbcc928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.894905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:27.900302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:27.904604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:27.926174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1073/2126] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:27.927680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:27.930357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:27.992628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1054/2127] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:27.993963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:27.994292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:27.994525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.050454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:28.052001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:28.079334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1055/2128] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:28.080999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.092164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b601a-4626-4ba2-b2d0-58e2da7b0c9b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.095827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306def09-2791-4366-92b5-417ec11d27e1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.099435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.100334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.100775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.101053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] PATH_INFO: `/v3/users/3c83d7bd21b04d4b9c6b208d3defab66` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.102229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c83d7bd21b04d4b9c6b208d3defab66)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.104314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.104587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.105553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.128461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.128941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.129760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:28.130284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.132259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.149370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:28.152565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1056/2129] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:28.154736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.167660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132812e-d1fc-4750-8ce5-211d5814ee94 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.176805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.177873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.178190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.178501 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.179711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.182686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.201755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c83d7bd21b04d4b9c6b208d3defab66'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:28.223334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c83d7bd21b04d4b9c6b208d3defab66'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:28.225935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c83d7bd21b04d4b9c6b208d3defab66'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:28.228146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c83d7bd21b04d4b9c6b208d3defab66'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:28.235621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1057/2130] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:28 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:28.241049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.244108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:28.273852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c37e68a-1a18-49d0-a765-b7b48cfe9d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c83d7bd21b04d4b9c6b208d3defab66'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:28.298777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1074/2131] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:27 2022] DELETE /identity/v3/users/3c83d7bd21b04d4b9c6b208d3defab66 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:28.300311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.300603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.300880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.336573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:28.338015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:28.351674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da309d-1b8a-4584-824a-e8bc4eeb5996 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.439192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1075/2132] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:28.456173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.457055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.457240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.457636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.458640 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.458767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.465186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.470006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:28.511538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1058/2133] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:28 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:28.512864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.524931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8e6a-668f-4dac-9ae3-5cf7b524eccc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.533512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.535485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.535603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.536109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.536779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.538786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.561483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1059/2134] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:28.562793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.568916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4bab-2577-4198-b59e-b33ebdd7809d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.572934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.573739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.574171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.574587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.576403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c377d-e821-439a-bec6-af699007d7c7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.582491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.584657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.584657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.584657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.584657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.589233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b3958-36d0-4724-b34d-8af87bd993a0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.591103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.592857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.606944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1076/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:28.608251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1060/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:28.613101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.623611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a098-58b7-42c2-824d-6de51c0353f8 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.632837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.633516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.633803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.634077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] PATH_INFO: `/v3/projects/5f02805f85114cfdb904508c3253b500/users/a65ffd52d1914ec0b294b2583d8e351a/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.653443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f02805f85114cfdb904508c3253b500, user_id=a65ffd52d1914ec0b294b2583d8e351a, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.655964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:28.685611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1077/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:28 2022] PUT /identity/v3/projects/5f02805f85114cfdb904508c3253b500/users/a65ffd52d1914ec0b294b2583d8e351a/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:28.690559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.690889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.691223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.720422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:28.732272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] MFA Rules not processed for user `a65ffd52d1914ec0b294b2583d8e351a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:28.735649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:28.845264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1061/2138] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:28.849466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:28.885882 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:28.966220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5c6c-d35d-43af-9c45-cdf871e5b625 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:28.971470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:28.972190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:28.972611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:28.973224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:28.973696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:28.976021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.016224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1078/2139] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:28 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:29.020308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.042309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730d5b-0d3b-40b2-834a-a51855be29a2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.207321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.207919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.208168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.208461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.209126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.211109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.254856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1062/2140] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:29 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:29.256377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.295745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576090f-077a-49d1-b39b-cc15a4724a4a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.314002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.314002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.314357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.314504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.318332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.335164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.354401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1079/2141] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:29.359898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.376720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d49d9-bc34-420e-88f3-0dc0a3182940 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.406788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.407513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.407794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.408107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] PATH_INFO: `/v3/projects/0042b091254d4d618aea9554950a78b1/users/4f499b75ae0d450eb2da38d236ee1aa6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.428612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0042b091254d4d618aea9554950a78b1, user_id=4f499b75ae0d450eb2da38d236ee1aa6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.432742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.466121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1063/2142] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:29 2022] PUT /identity/v3/projects/0042b091254d4d618aea9554950a78b1/users/4f499b75ae0d450eb2da38d236ee1aa6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:29.472398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.485313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.486278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc93c5-ff11-4395-9d54-252ba1fa12b1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.488411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.586895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.587565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.587852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.588127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.588791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.590686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.608119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1080/2143] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:29.614453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.616621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.642600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26cb7-311a-4c51-983d-32aec8badbbd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.648197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.649042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.649473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.649896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] PATH_INFO: `/v3/projects/62a5adb3629f4034a62cee030343fd03` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.651374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a5adb3629f4034a62cee030343fd03)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.653816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.661704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:29.701253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721482f4-3667-4297-a41c-8511ec9a90ea admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.705645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.706389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.706790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.707282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.709758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.770154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a5adb3629f4034a62cee030343fd03', 'request_id': 'req-63684266-03ac-47df-bc97-782438882f41'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:29.776910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:29.782181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a5adb3629f4034a62cee030343fd03', 'request_id': 'req-63684266-03ac-47df-bc97-782438882f41'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:29.790644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a5adb3629f4034a62cee030343fd03', 'request_id': 'req-63684266-03ac-47df-bc97-782438882f41'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:29.808894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] The token cache is being invalidate because project 62a5adb3629f4034a62cee030343fd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:29.809239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:29.809348 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.809934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:29.811426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abf0ce-5b31-47f4-b9c6-7dff92ece3f2 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.814863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1064/2144] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:29 2022] DELETE /identity/v3/projects/62a5adb3629f4034a62cee030343fd03 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:29.814863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:29.814863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.856527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1081/2145] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:29.860342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397208b-e8b8-49ef-95d1-ca542594b0b4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.862122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397208b-e8b8-49ef-95d1-ca542594b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.862417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397208b-e8b8-49ef-95d1-ca542594b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.907437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6397208b-e8b8-49ef-95d1-ca542594b0b4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:29.909110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6397208b-e8b8-49ef-95d1-ca542594b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.920171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1082/2146] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:29.922547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63684266-03ac-47df-bc97-782438882f41 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:29.928983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.930004 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.930456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.932999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:29.933767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.934245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.934457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] PATH_INFO: `/v3/projects/0042b091254d4d618aea9554950a78b1/users/4f499b75ae0d450eb2da38d236ee1aa6/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:29.936483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0042b091254d4d618aea9554950a78b1, user_id=4f499b75ae0d450eb2da38d236ee1aa6, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:29.939305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057c22a-61c2-481d-ae04-90548bd336b3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:29.951436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:29.953187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:29.955142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1065/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:29 2022] PUT /identity/v3/projects/0042b091254d4d618aea9554950a78b1/users/4f499b75ae0d450eb2da38d236ee1aa6/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:29.964418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:29.964710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:29.964987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.003451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] MFA Rules not processed for user `4f499b75ae0d450eb2da38d236ee1aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:30.005434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:30.037299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1083/2148] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:30.041891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.055167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2592b-ff16-403f-8901-cefb5bf6cd12 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.059935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.060542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.060821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.061091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.061736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:30.062070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.063699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.082134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1084/2149] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:30.083200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.094714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b95a4-f8de-4bdd-9eb1-50a7f0249b12 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.100101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.101207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.101207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.101536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.102449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.109046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.109207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1066/2150] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:30.121056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.123560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:30.143745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:30.144300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1085/2151] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:30 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:30.148359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.201176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518c227-4d7f-4958-884a-1ec39cfd7c02 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.295159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6c12f-9cfb-4e49-ad27-68a125ede1cf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.296875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.297585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.298025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.298374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.300572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:30.301032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.301654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.301935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.302309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.303422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.305139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.352106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1086/2152] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:30 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:30.353361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.366745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8ac5-44f8-4c71-aea8-6ea7a64ee984 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.373896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.375501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.375801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.376211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.377073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.379356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.401055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1087/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:30.402360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.418999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eab515-f1dc-4541-b3b6-8cd1edbfbdab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.427780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.428187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.428476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.428757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.429512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.433976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.459515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1088/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:30.460431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.473982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292574a-11b3-4689-bf45-eec488a33c94 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.486727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.487522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.487732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.488014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] PATH_INFO: `/v3/projects/415259f0542c4f54902636cd6bec3dbb/users/9945c0f28b4e482c91cd98c3e0608d21/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.510470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:30.543110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] RBAC: Authorizing `identity:create_grant(project_id=415259f0542c4f54902636cd6bec3dbb, user_id=9945c0f28b4e482c91cd98c3e0608d21, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.547315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.547559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:30.555340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe88857-bd3f-4b8d-b767-23a006caad96 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:30.572396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1067/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:30.593510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1089/2156] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:30 2022] PUT /identity/v3/projects/415259f0542c4f54902636cd6bec3dbb/users/9945c0f28b4e482c91cd98c3e0608d21/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:30.604571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.605112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.605541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:30.651569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] MFA Rules not processed for user `9945c0f28b4e482c91cd98c3e0608d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:30.652794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:30.821669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1068/2157] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:30.910590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:30.912558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:30.990721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7505c7-00ca-454a-930e-ba07d87d419a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:30.994781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:30.995467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:30.995799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:30.996083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.006319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:31.008191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:31.019077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1090/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:31.040550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:31.060381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:31.082880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:31.096720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0d7b2-75d2-4008-8b65-b334c29fe4f6 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:31.124585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:31.125159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:31.125493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:31.125771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.131844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:31.213816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a73d-c132-4890-b0de-448a0b69df03 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:31.220447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:31.221366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:31.222664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:31.222664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] PATH_INFO: `/v3/users/9945c0f28b4e482c91cd98c3e0608d21` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.223301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9945c0f28b4e482c91cd98c3e0608d21)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:31.225543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:31.226796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:31.228404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe1c50-d727-4ab8-b627-29770bcf169a service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:31.243654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1091/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:31.308204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9945c0f28b4e482c91cd98c3e0608d21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:31.321373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9945c0f28b4e482c91cd98c3e0608d21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:31.325006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9945c0f28b4e482c91cd98c3e0608d21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:31.326071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9945c0f28b4e482c91cd98c3e0608d21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:31.338448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9945c0f28b4e482c91cd98c3e0608d21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:31.361045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1069/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:31 2022] DELETE /identity/v3/users/9945c0f28b4e482c91cd98c3e0608d21 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:31.365390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:31.366523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:31.366918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.392480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:31.393682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:31.471350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1092/2161] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:31.483296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:31.485411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:31.548351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0556b7-a15e-47fc-b1ee-f5c0ccac3eb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:31.552196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:31.552965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:31.553245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:31.553516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.563169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:31.564546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4d01-f112-468b-9941-8eb0f17c6d95 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:31.574283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1070/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:31.918259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:31.920433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:31.937604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c1ba-eba1-4949-b717-ce20f216cd02 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:31.943448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:31.944100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:31.944383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:31.944696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] PATH_INFO: `/v3/projects/415259f0542c4f54902636cd6bec3dbb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:31.945820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415259f0542c4f54902636cd6bec3dbb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:31.947799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:31.974438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:32.021322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415259f0542c4f54902636cd6bec3dbb', 'request_id': 'req-cce82422-b808-44b9-b3a3-4e9f458d5ce3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:32.027672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415259f0542c4f54902636cd6bec3dbb', 'request_id': 'req-cce82422-b808-44b9-b3a3-4e9f458d5ce3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:32.034686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415259f0542c4f54902636cd6bec3dbb', 'request_id': 'req-cce82422-b808-44b9-b3a3-4e9f458d5ce3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:32.046941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] The token cache is being invalidate because project 415259f0542c4f54902636cd6bec3dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:32.047268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:32.047986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:32.049670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1093/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:31 2022] DELETE /identity/v3/projects/415259f0542c4f54902636cd6bec3dbb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:32.054424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68a84-b970-4145-a464-3492d3ffabac None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.054882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68a84-b970-4145-a464-3492d3ffabac None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.054976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c68a84-b970-4145-a464-3492d3ffabac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.074847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a1c68a84-b970-4145-a464-3492d3ffabac None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:32.076086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1c68a84-b970-4145-a464-3492d3ffabac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.126709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:32.158955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1071/2164] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:32.163249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.164725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.168068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.168535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.168831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.197817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:32.199376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.207806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1072/2165] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:32.215404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.227969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480136-88fa-4fb5-8d46-7eaab95a6b5f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.236066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.236721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.236994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.237258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.238010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:32.239163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.239783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82422-b808-44b9-b3a3-4e9f458d5ce3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.240654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.245326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.246037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.246526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.246811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.250680 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.254948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1073/2166] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:32.259120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.270574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9975f7-d55a-4534-8fc8-a3f59604a16b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.276037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.276866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.277156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.277443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.278061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.280048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.314945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1074/2167] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:32 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:32.318917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.329382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.331112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.342298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1094/2168] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:32.396616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42701e-4002-4414-93c0-4bfdbb389d41 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.403593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.404214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.404491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.404764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.405396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.407956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.456412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1075/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:32 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:32.464571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.486891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a141004-b5dc-4fd1-805a-8179b27ea17c service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.494325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.495376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.496094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.496572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.497443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.499656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.523325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1095/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:32.529000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.564243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85346-1b5f-4b04-aa03-804af57de072 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.574780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.575518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.575803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.576072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.576735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.578453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f4922-cc93-40f5-be5f-534e42ef75ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.594012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1076/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:32.594913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.609822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba78195-7aeb-4168-8ff1-7c9b8642ba26 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.618311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.619888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.620404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.620837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] PATH_INFO: `/v3/projects/949da098417a42c4870f51ce92360af2/users/6e97846704974c788301b02c5e114425/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.648121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949da098417a42c4870f51ce92360af2, user_id=6e97846704974c788301b02c5e114425, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.651559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:32.674387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1096/2172] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:32 2022] PUT /identity/v3/projects/949da098417a42c4870f51ce92360af2/users/6e97846704974c788301b02c5e114425/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:32.685575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.686282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.686790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.754588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] MFA Rules not processed for user `6e97846704974c788301b02c5e114425`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:32.756237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.859386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1077/2173] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:32.881540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:32.883925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:32.925165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:32.972343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5fc4-383d-41c7-b539-192495a8b1e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:32.977075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:32.978859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:32.979323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:32.979663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:32.991072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:32.992687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecd2f8-d784-4d21-9c21-f9bba22bf073 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:33.003782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1097/2174] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:35.545712 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:35.549484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:35.558048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:35.641183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9105-e2fd-4999-9b4f-b7a5406ef698 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:35.646506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:35.647303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:35.647586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:35.647860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] PATH_INFO: `/v3/users/f70d6c4dc3d54eb7960babd0dda1b678` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:35.649015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70d6c4dc3d54eb7960babd0dda1b678)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:35.651139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:35.768305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70d6c4dc3d54eb7960babd0dda1b678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:35.798740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70d6c4dc3d54eb7960babd0dda1b678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:35.799654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70d6c4dc3d54eb7960babd0dda1b678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:35.800349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70d6c4dc3d54eb7960babd0dda1b678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:35.813692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70d6c4dc3d54eb7960babd0dda1b678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:35.839167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1078/2175] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:35 2022] DELETE /identity/v3/users/f70d6c4dc3d54eb7960babd0dda1b678 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:35.840821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:35.841270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:35.841387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:35.870287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:35.872497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:35.967485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1098/2176] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:35.984355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:35.986063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:36.064179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111905-9757-4191-8309-fbe50fe666b3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:36.069768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:36.070475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:36.070822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:36.071100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:36.082079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:36.083837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026a8cc-cbf2-4ff9-b6ff-83c5b30a24bd service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:36.095959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1079/2177] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:36.409101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:36.410655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:36.424902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbcb1e-1437-4607-9937-0b4aab1cab49 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:36.432447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:36.433766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:36.434227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:36.434672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] PATH_INFO: `/v3/users/a65ffd52d1914ec0b294b2583d8e351a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:36.437131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65ffd52d1914ec0b294b2583d8e351a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:36.440751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:36.526548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65ffd52d1914ec0b294b2583d8e351a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.548905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65ffd52d1914ec0b294b2583d8e351a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.553545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65ffd52d1914ec0b294b2583d8e351a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.556664 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65ffd52d1914ec0b294b2583d8e351a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.575930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65ffd52d1914ec0b294b2583d8e351a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.604313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1099/2178] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:36 2022] DELETE /identity/v3/users/a65ffd52d1914ec0b294b2583d8e351a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:36.606469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:36.608218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:36.608218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:36.630843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:36.632383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:36.658762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:36.711272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:36.715704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:36.725755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1080/2179] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:36.737021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:36.738488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:36.747262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad58b62-0956-4080-b405-8de54bb955c1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:36.761896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:36.762549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:36.762834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:36.763127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] PATH_INFO: `/v3/projects/a81eb237017f451eb4636112f8e4de9e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:36.765121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81eb237017f451eb4636112f8e4de9e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:36.782627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:36.818659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e0bd8-92e9-4bf8-88f6-2b4177780ea5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:36.822637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:36.823301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:36.823579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:36.823848 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:36.834331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:36.835928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:36.860317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1081/2180] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:36.865467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:36.891645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81eb237017f451eb4636112f8e4de9e', 'request_id': 'req-fac76439-ae9c-4610-b9c5-383a931ca6cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.898128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81eb237017f451eb4636112f8e4de9e', 'request_id': 'req-fac76439-ae9c-4610-b9c5-383a931ca6cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.908476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81eb237017f451eb4636112f8e4de9e', 'request_id': 'req-fac76439-ae9c-4610-b9c5-383a931ca6cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.923238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] The token cache is being invalidate because project a81eb237017f451eb4636112f8e4de9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:36.923594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.924314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fac76439-ae9c-4610-b9c5-383a931ca6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:36.925959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1100/2181] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:36 2022] DELETE /identity/v3/projects/a81eb237017f451eb4636112f8e4de9e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:36.930516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:36.944620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-7ec1-45e9-a346-86cb667af7c3 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:37.024471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:37.025521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.025521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.025851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] PATH_INFO: `/v3/users/dad0e07f572c4af3b6365ca697390e2b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.027506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad0e07f572c4af3b6365ca697390e2b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:37.030098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:37.085350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad0e07f572c4af3b6365ca697390e2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.095944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad0e07f572c4af3b6365ca697390e2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.096857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad0e07f572c4af3b6365ca697390e2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.098389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad0e07f572c4af3b6365ca697390e2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.107008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-24b51126-eeac-41b5-8680-d6aa25b34f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad0e07f572c4af3b6365ca697390e2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.123996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:37.142456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1082/2182] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:36 2022] DELETE /identity/v3/users/dad0e07f572c4af3b6365ca697390e2b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:37.256103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.256391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.256681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.258312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1101/2183] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:14:37.316931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.317218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.317492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.320060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:37.323673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.362513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:37.364920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.439550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ea474-61ca-4b3b-8faa-942f0a05ab37 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:37.445292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:37.446071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.446681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.447082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] PATH_INFO: `/v3/projects/5f02805f85114cfdb904508c3253b500` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.453538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f02805f85114cfdb904508c3253b500)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:37.456248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:37.533237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1083/2184] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:37.533543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f02805f85114cfdb904508c3253b500', 'request_id': 'req-d9c9735b-74cd-4a52-993e-e03d6fa198a3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.535020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:37.537809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.543771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f02805f85114cfdb904508c3253b500', 'request_id': 'req-d9c9735b-74cd-4a52-993e-e03d6fa198a3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.565266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f02805f85114cfdb904508c3253b500', 'request_id': 'req-d9c9735b-74cd-4a52-993e-e03d6fa198a3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.566649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86c3f-7122-4ee1-a009-e41bad318903 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:37.586394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] The token cache is being invalidate because project 5f02805f85114cfdb904508c3253b500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:37.586694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.588182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.599144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1102/2185] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:37 2022] DELETE /identity/v3/projects/5f02805f85114cfdb904508c3253b500 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:37.600694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:37.602337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.660142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:37.661140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.661555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.661853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] PATH_INFO: `/v3/users/c12b9e26465e42ad8b41f0347074a1a9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.663362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12b9e26465e42ad8b41f0347074a1a9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:37.666015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:37.669099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:37.698628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9735b-74cd-4a52-993e-e03d6fa198a3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:37.706831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:37.707589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.707937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.708218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.710521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.725654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:37.727515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:37.733473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12b9e26465e42ad8b41f0347074a1a9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.740090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1103/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:37.740951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:37.742371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.755169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12b9e26465e42ad8b41f0347074a1a9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.757409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12b9e26465e42ad8b41f0347074a1a9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.766806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12b9e26465e42ad8b41f0347074a1a9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.774108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c78f6-5bbd-41b3-9325-1b373a11f03f service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:37.776854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12b9e26465e42ad8b41f0347074a1a9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.797227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:37.798989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:37.799895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:37.800495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] PATH_INFO: `/v3/users/4f499b75ae0d450eb2da38d236ee1aa6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:37.801561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1084/2187] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:37 2022] DELETE /identity/v3/users/c12b9e26465e42ad8b41f0347074a1a9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:37.802583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f499b75ae0d450eb2da38d236ee1aa6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:37.805201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:37.933397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f499b75ae0d450eb2da38d236ee1aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.952835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f499b75ae0d450eb2da38d236ee1aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.956033 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f499b75ae0d450eb2da38d236ee1aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.957811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:37.959699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:37.960112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f499b75ae0d450eb2da38d236ee1aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:37.972054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:37.995440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f499b75ae0d450eb2da38d236ee1aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.020150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1104/2188] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:37 2022] DELETE /identity/v3/users/4f499b75ae0d450eb2da38d236ee1aa6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:38.067755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601453-f929-46e0-bbc5-6b1e39d840a1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.087401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.087401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.180600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.181310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.181666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.182193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] PATH_INFO: `/v3/projects/761f3d0c7a864b769b8408bfd8cc75ff` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.183422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761f3d0c7a864b769b8408bfd8cc75ff)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.185532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.222255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030c2c-6dce-424d-a8a4-0008ec03d60f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.228039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.228979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.229091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.229356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] PATH_INFO: `/v3/projects/fc9f516c579b403ba77df96bbca5cf4c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.230845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9f516c579b403ba77df96bbca5cf4c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.234005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.301403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9f516c579b403ba77df96bbca5cf4c', 'request_id': 'req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.303937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:38.308954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761f3d0c7a864b769b8408bfd8cc75ff', 'request_id': 'req-7f44f1e5-fe6c-49db-8f58-8358a4e74148'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.311216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9f516c579b403ba77df96bbca5cf4c', 'request_id': 'req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.322693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9f516c579b403ba77df96bbca5cf4c', 'request_id': 'req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.336936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761f3d0c7a864b769b8408bfd8cc75ff', 'request_id': 'req-7f44f1e5-fe6c-49db-8f58-8358a4e74148'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.342217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] The token cache is being invalidate because project fc9f516c579b403ba77df96bbca5cf4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:38.343672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.344175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13c72ed1-378e-41e0-84e6-1d8c70f6bcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.346026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1105/2189] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:38 2022] DELETE /identity/v3/projects/fc9f516c579b403ba77df96bbca5cf4c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:38.348171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761f3d0c7a864b769b8408bfd8cc75ff', 'request_id': 'req-7f44f1e5-fe6c-49db-8f58-8358a4e74148'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.350987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.351414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.351796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.363023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] The token cache is being invalidate because project 761f3d0c7a864b769b8408bfd8cc75ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:38.363345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.364112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.370006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1085/2190] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:37 2022] DELETE /identity/v3/projects/761f3d0c7a864b769b8408bfd8cc75ff => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:38.370886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.372320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.390775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:38.392133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.427295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:38.459852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f1e5-fe6c-49db-8f58-8358a4e74148 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.484158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1106/2191] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:38.485397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.486904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.510899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f08f-3421-4317-9fd7-f122d7290d25 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.516853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.517525 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.517801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.518255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] PATH_INFO: `/v3/projects/0042b091254d4d618aea9554950a78b1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.520927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0042b091254d4d618aea9554950a78b1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.523877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.561245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.563805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.564236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.564495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] PATH_INFO: `/v3/users/53976be677314e02bb0d5ff1801907d0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.566498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53976be677314e02bb0d5ff1801907d0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.568852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.613121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0042b091254d4d618aea9554950a78b1', 'request_id': 'req-b997f468-16c8-4c53-873f-7e0cf19e3093'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.619549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0042b091254d4d618aea9554950a78b1', 'request_id': 'req-b997f468-16c8-4c53-873f-7e0cf19e3093'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.627161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53976be677314e02bb0d5ff1801907d0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.628954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0042b091254d4d618aea9554950a78b1', 'request_id': 'req-b997f468-16c8-4c53-873f-7e0cf19e3093'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.638322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53976be677314e02bb0d5ff1801907d0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.639245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53976be677314e02bb0d5ff1801907d0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.641457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53976be677314e02bb0d5ff1801907d0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.644819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] The token cache is being invalidate because project 0042b091254d4d618aea9554950a78b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:38.645113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.645783 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b997f468-16c8-4c53-873f-7e0cf19e3093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.647393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1107/2192] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:38 2022] DELETE /identity/v3/projects/0042b091254d4d618aea9554950a78b1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:38.650583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-57a21dc2-2a37-4ba7-adea-4de5796da74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53976be677314e02bb0d5ff1801907d0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:38.651858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.652144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.652419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.671800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1086/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:38 2022] DELETE /identity/v3/users/53976be677314e02bb0d5ff1801907d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:38.672327 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:38.673255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.675920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4565a03-13a9-4361-a556-5f40b5c172b9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.676232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4565a03-13a9-4361-a556-5f40b5c172b9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.676480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4565a03-13a9-4361-a556-5f40b5c172b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.712220 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a4565a03-13a9-4361-a556-5f40b5c172b9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:38.713498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a4565a03-13a9-4361-a556-5f40b5c172b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.773246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1108/2194] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:38.778288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.783705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:38.787802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f520-72a5-4573-be2e-dce08241a299 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.794119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.795621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.795814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1087/2195] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:38.796433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.796794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.798933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:38.799504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.801718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.805151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.805444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.805699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.818523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1109/2196] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:38.821594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:38.823628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.829398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:38.831652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:38.835071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a845-e711-4e74-943c-a529d5db295d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.849262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.849881 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.850266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.851108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.851872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.856148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.867531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1088/2197] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:38.869151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.883060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29442ad-bfaf-4bb5-be65-681768adf9d9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.891360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.892147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.892671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.892944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.893638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:38.893935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.895641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.910647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1089/2198] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:38.915184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.927179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6a11-62bb-4e90-b079-5e8fd79b6f6d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:38.934172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:38.935171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:38.935520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:38.935864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:38.937889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:38.941493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1110/2199] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:38.945683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:38.950670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:38.995524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1090/2200] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:38.999998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.090247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd4ca-c0b2-4952-8de3-5044a1dfa107 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.109251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e606d-b390-4361-baa9-71d816c2dcb6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.116671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.117681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.118024 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.118705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.119949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.122377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.154708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1091/2201] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:39.155914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.158137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.174068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dea0d6-0079-4ee9-a29f-e4ddd8683e85 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.179145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.179925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.180274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.180646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] PATH_INFO: `/v3/projects/e28fd6e691664489b8e1ddf9db54e71c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.181857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28fd6e691664489b8e1ddf9db54e71c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.183986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.202743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.203670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.204159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.204437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.205370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.207585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.233091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1111/2202] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:38 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:39.233091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.241060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4fa5a-f566-4368-9d98-cdb7d4e0716a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.243910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28fd6e691664489b8e1ddf9db54e71c', 'request_id': 'req-e176f901-0864-4d11-91d5-b32d2d4847ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:39.252774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28fd6e691664489b8e1ddf9db54e71c', 'request_id': 'req-e176f901-0864-4d11-91d5-b32d2d4847ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:39.258483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28fd6e691664489b8e1ddf9db54e71c', 'request_id': 'req-e176f901-0864-4d11-91d5-b32d2d4847ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:39.273332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] The token cache is being invalidate because project e28fd6e691664489b8e1ddf9db54e71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:39.273688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:39.274375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:39.275939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1092/2203] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:39 2022] DELETE /identity/v3/projects/e28fd6e691664489b8e1ddf9db54e71c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:39.276704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.278845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.300623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.301158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.301438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.301714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.302357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.303999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714fe64-6908-408c-ada1-1c4c75608756 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.318595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1112/2204] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.318595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.318595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.318595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.320667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:39.325457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:39.339913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:39.341107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.346274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f901-0864-4d11-91d5-b32d2d4847ff admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.349607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1113/2205] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:39.350424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.352047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.355530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.355530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.355530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.355530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.355939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.356774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18656d19-caf4-40d9-872e-c3366f5097c9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.367902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e55d5-1ea0-477d-8e3e-1d4ae9f78edf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.372343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1093/2206] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.372343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.372343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.372343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.376306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.376908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.377185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.377454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.378093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.379715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.393797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1114/2207] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.393977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:39.394076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.394185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.400582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1094/2208] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:39.403258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6267-764b-4d83-96e6-61d0eec715c5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.403369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.407904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.408481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.408757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.409026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.409683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.410805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81db1-5060-4bbc-9ce9-d46a3adf9ca8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.411284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.415540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.416175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.416459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.416732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] PATH_INFO: `/v3/projects/3c8c9282cce24f69be77dc3444cd6f11/users/c1dbee55c528441e8b54d6059da83d35/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.421417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1115/2209] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.422276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.431864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a637-5805-4e46-b918-f94383c4b071 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.432402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8c9282cce24f69be77dc3444cd6f11, user_id=c1dbee55c528441e8b54d6059da83d35, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.435334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.437761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.438369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.438649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.438923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.439700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:39.440011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.442095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6868-528b-42ff-8496-d4c82629dab7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.449904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1095/2210] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:39 2022] PUT /identity/v3/projects/3c8c9282cce24f69be77dc3444cd6f11/users/c1dbee55c528441e8b54d6059da83d35/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:39.450695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.460320 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1116/2211] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:39.461867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660bb0-d10e-471e-bb21-49745ecd4b86 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.462232 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660bb0-d10e-471e-bb21-49745ecd4b86 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.462580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660bb0-d10e-471e-bb21-49745ecd4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.492089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-37660bb0-d10e-471e-bb21-49745ecd4b86 None None] MFA Rules not processed for user `c1dbee55c528441e8b54d6059da83d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:39.493314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37660bb0-d10e-471e-bb21-49745ecd4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.518328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024897f-1f05-44f9-977b-dd8cc23d1e75 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.525039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.525736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.526017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.526293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] PATH_INFO: `/v3/projects/1a257f8701524c21b6d155cc56dafd5a/users/ab3052e5c0b64d758990d0b78f48a00f/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.541629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a257f8701524c21b6d155cc56dafd5a, user_id=ab3052e5c0b64d758990d0b78f48a00f, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.544680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.558143 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1096/2212] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:39 2022] PUT /identity/v3/projects/1a257f8701524c21b6d155cc56dafd5a/users/ab3052e5c0b64d758990d0b78f48a00f/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:39.559115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.563915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1117/2213] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:39.567613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.567613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.567613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.585533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:39.586905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.624859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073707-da9d-4bc6-8db4-98b9349cf580 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.635961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.636776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.637074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.637342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.638632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.640756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.652690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1118/2214] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:39.653614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.668761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6c87a-b7da-404a-a54a-19e9ec98bbbc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.674151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.674842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.675217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.675642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.676154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.678478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.698070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1097/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:39.698070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.700437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:39.717095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1119/2216] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:39.717095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.726196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:39.762775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:39.801788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b257a-5caa-4e67-ab7a-b69d1cef184c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.806597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b026782-79ea-4612-876b-fdbb5eccea93 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.820263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.820888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.821172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.821460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.822097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.824071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.856448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1120/2217] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:39.857318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.874960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574eae1-f023-44ef-b334-3a223ba379fd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.881162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.881932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.882695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.883184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.883362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.883845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.884180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.884335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.884449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.886903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.895240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.896730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.909977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1098/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:39.910802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.920366 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1121/2219] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:39 2022] POST /identity/v3/users => generated 293 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:39.920588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64185-eff7-48a9-a9a3-821cd8ba4f33 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.925642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.926125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.926750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.927048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.927360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.928018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.929660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.940749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589ea87-bdce-4d73-9045-febfaf239a42 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.942824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1099/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.947200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.949137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.949859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.950201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.950536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.951332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.953834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.959310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a1d53-898e-4fe5-80d0-81ca8ff2278c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:39.966307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:39.967414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:39.967537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:39.968735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:39.969537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:39.971362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:39.971645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1122/2221] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.976016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.989061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1100/2222] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:39.991622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:39.997314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150c3a7-a888-4106-aa51-cd8f5362a9b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.003454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.004068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.004341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.004785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.005389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.007145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.012961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d16c52-f22d-4ec0-94b1-5d0e7150e6ac admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.018602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.019473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.019790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.020396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] PATH_INFO: `/v3/projects/b0eb6de113e245ff90165445e3482aac/users/7e1b91a85430434c847a63dfed434852/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.025013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1123/2223] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:40.028878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.043184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf3c1-b762-4a34-abc9-40b42ed439a5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.052032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.053146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.053432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.053922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] PATH_INFO: `/v3/projects/9de89373f7d54b16b8357d7284d7793c/users/2b50ac156ebb42da8a22b4e48fef9e62/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.056009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eb6de113e245ff90165445e3482aac, user_id=7e1b91a85430434c847a63dfed434852, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.058742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebee9c-be5b-471d-bb49-dcf019dbae8b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.072517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de89373f7d54b16b8357d7284d7793c, user_id=2b50ac156ebb42da8a22b4e48fef9e62, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.075493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df82072-7ed0-46ca-bea0-5fb8bf6e09ff admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.099181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1101/2224] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:39 2022] PUT /identity/v3/projects/b0eb6de113e245ff90165445e3482aac/users/7e1b91a85430434c847a63dfed434852/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:40.113858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.114104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.114882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.129534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1124/2225] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:40 2022] PUT /identity/v3/projects/9de89373f7d54b16b8357d7284d7793c/users/2b50ac156ebb42da8a22b4e48fef9e62/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:40.131016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.131336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.131617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.185096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] MFA Rules not processed for user `7e1b91a85430434c847a63dfed434852`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:40.186085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:40.204355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] MFA Rules not processed for user `2b50ac156ebb42da8a22b4e48fef9e62`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:40.206985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:40.327571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1102/2226] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:40.338820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.340757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:40.353268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1125/2227] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:40.358924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.361660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:40.449395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70bdc7-2f9e-4aa4-a116-28206fa3a7d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.457482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.458322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.458435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.458641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.465247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:40.471072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.473123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.484408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1103/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:40.491618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6c55-c99a-457a-bb44-a28c8bfbc028 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.503155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.503155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.503155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.503155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.503583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.504100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.543211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1126/2229] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:40.545729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.560079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964e96-2846-437f-ad91-f970a13e99c7 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.667224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.667224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.667224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.667224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.667795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.669111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.711190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1104/2230] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:40 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:40.712907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.727253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f86787-4237-4d8d-b3ea-63dcdca951fd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.734909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.735622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.735954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.736234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.737416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.741067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.757816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1127/2231] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:40.759586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.776380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe2c97-8ba4-4e35-93c8-1b01ed01de9c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.783589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.784390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.784661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.784981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] PATH_INFO: `/v3/projects/43aaf1d178644c1da680c4694d74ab52/users/7943dbba53014260b090cc98d20c135d/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.812063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43aaf1d178644c1da680c4694d74ab52, user_id=7943dbba53014260b090cc98d20c135d, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.814894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.837744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1105/2232] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:40 2022] PUT /identity/v3/projects/43aaf1d178644c1da680c4694d74ab52/users/7943dbba53014260b090cc98d20c135d/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:40.841979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.853617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12184462-4097-427c-9116-a374218dd3f5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:40.960726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:40.961504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:40.962165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:40.962553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:40.963797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:40.965693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63af88-c5e4-496b-962a-be2d9585a218 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:40.982029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1128/2233] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:40.982735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:40.997910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be8d1-4aa4-4e77-b7c0-71ba4488ed3f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:41.018761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:41.018761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:41.018761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:41.018761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] PATH_INFO: `/v3/projects/43aaf1d178644c1da680c4694d74ab52/users/7943dbba53014260b090cc98d20c135d/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:41.019867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43aaf1d178644c1da680c4694d74ab52, user_id=7943dbba53014260b090cc98d20c135d, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:41.026828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:41.051783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1106/2234] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:40 2022] PUT /identity/v3/projects/43aaf1d178644c1da680c4694d74ab52/users/7943dbba53014260b090cc98d20c135d/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:41.058687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:41.059181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:41.059535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:41.100076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] MFA Rules not processed for user `7943dbba53014260b090cc98d20c135d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:41.101405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:41.239768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1129/2235] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:41.284393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:41.368611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112957d-84cd-42f0-a51e-587efb7b0184 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:41.373305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:41.373831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:41.374718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:41.375082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:41.388690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:41.391488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5855d6-cce1-4773-95b9-2af9d5400300 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:41.419460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1107/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:42.140949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:42.142758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:42.158046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f9d5-868a-4aac-bdbd-b905128a5977 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:42.184201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:42.184987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:42.185286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:42.186147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:42.265486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:42.289200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:42.291526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:42.322535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1130/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:45.470013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:45.470492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:45.470569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:45.503682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:45.519485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] MFA Rules not processed for user `ab3052e5c0b64d758990d0b78f48a00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:45.521065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:45.732214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1108/2238] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:45.741360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:45.743329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:45.851672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007e2db-94ec-4ce2-a55a-5c5ae64ab1ac service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:45.857483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:45.859160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:45.859475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:45.859737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:45.868583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:45.870186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:45.880700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1131/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:46.245477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:46.260509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9d314-d0ad-4f64-8130-5682c431a829 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:46.265566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:46.266541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:46.266859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:46.267161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:46.271011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:46.397809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:46.400644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5898a0c-d5b9-4d5f-b15e-d38827b54e82 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:46.425048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1109/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:47.047280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:47.061700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce739766-53f9-4433-8cda-7e5f1ecaf09e service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:47.075673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:47.075673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:47.075673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:47.075673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:47.166452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:47.168002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:47.177408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1132/2241] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:47.948977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8112-b7ee-41b3-b036-af17343d6d02 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:47.950234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8112-b7ee-41b3-b036-af17343d6d02 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:47.950659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8112-b7ee-41b3-b036-af17343d6d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:47.974307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2f6f8112-b7ee-41b3-b036-af17343d6d02 None None] MFA Rules not processed for user `ab3052e5c0b64d758990d0b78f48a00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:47.975786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f6f8112-b7ee-41b3-b036-af17343d6d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:47.988011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1110/2242] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:48.731708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:48.733788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:48.880952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cde07-0e42-4020-a3d0-b278c0fb327f service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:48.894642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:48.895390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:48.895670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:48.895942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] PATH_INFO: `/v3/users/98353f5c78634ae08f1479cca4317818` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:48.897920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98353f5c78634ae08f1479cca4317818)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:48.899895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:48.902977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:48.981860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98353f5c78634ae08f1479cca4317818'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:48.993578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98353f5c78634ae08f1479cca4317818'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:48.994877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98353f5c78634ae08f1479cca4317818'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:48.995667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98353f5c78634ae08f1479cca4317818'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:49.024132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98353f5c78634ae08f1479cca4317818'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:49.040825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1133/2243] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:48 2022] DELETE /identity/v3/users/98353f5c78634ae08f1479cca4317818 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:49.046253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213079-2698-4f24-970c-7be21a45349a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:49.047084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213079-2698-4f24-970c-7be21a45349a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:49.047505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b213079-2698-4f24-970c-7be21a45349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:49.075147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8b213079-2698-4f24-970c-7be21a45349a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:49.079349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b213079-2698-4f24-970c-7be21a45349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:49.194853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1111/2244] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:49.205752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:49.207349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:49.290269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e7e3-cbb6-4e45-8ec5-42a4352b09c8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:49.302055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:49.309546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:49.309764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:49.310049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:49.330639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:49.332307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:49.346847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1134/2245] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:49.890769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b213079-2698-4f24-970c-7be21a45349a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:49.894877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b213079-2698-4f24-970c-7be21a45349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:49.956714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b213079-2698-4f24-970c-7be21a45349a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:49.984528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:49.985560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:49.986190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:49.986681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] PATH_INFO: `/v3/projects/95db2d81779144fda20d352526543edb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:49.988757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95db2d81779144fda20d352526543edb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:49.995586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.045165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.046910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:50.087441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.091898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f61a52-32f5-447e-9889-16abc0876dd1 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.118306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.119446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.119842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.120210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] PATH_INFO: `/v3/users/c1dbee55c528441e8b54d6059da83d35` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.123199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1dbee55c528441e8b54d6059da83d35)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.126533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.164327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95db2d81779144fda20d352526543edb', 'request_id': 'req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.188074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95db2d81779144fda20d352526543edb', 'request_id': 'req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.198583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95db2d81779144fda20d352526543edb', 'request_id': 'req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.236212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] The token cache is being invalidate because project 95db2d81779144fda20d352526543edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:50.236586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.238915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3cfcf718-aadc-4e83-91cf-36f8d7fbdb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.244161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1112/2246] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:49 2022] DELETE /identity/v3/projects/95db2d81779144fda20d352526543edb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:50.246487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebfa7-ce2a-460c-9f48-4cacbfed77f4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.247364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebfa7-ce2a-460c-9f48-4cacbfed77f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.247654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebfa7-ce2a-460c-9f48-4cacbfed77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.260178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1dbee55c528441e8b54d6059da83d35'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.272546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c2bebfa7-ce2a-460c-9f48-4cacbfed77f4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:50.274468 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c2bebfa7-ce2a-460c-9f48-4cacbfed77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:50.275422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1dbee55c528441e8b54d6059da83d35'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.276228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1dbee55c528441e8b54d6059da83d35'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.277248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1dbee55c528441e8b54d6059da83d35'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.302164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6d83c336-9ec4-48f4-be97-019d8906d625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1dbee55c528441e8b54d6059da83d35'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:50.311198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.332297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1135/2247] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:50 2022] DELETE /identity/v3/users/c1dbee55c528441e8b54d6059da83d35 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:50.335832 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.336312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.336734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.359226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1113/2248] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:50.362088 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.362525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.362775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.379644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:50.382028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:50.390403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:50.392178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:50.466517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1136/2249] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:50.481684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.486699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:50.534234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1114/2250] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:50.538448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.551902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed27d1-d358-4e64-b7c4-f2d11b6c4051 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.559352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.560401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.560894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.562217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.563464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:50.570152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.572929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.608732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1115/2251] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:14:50.612916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.624171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda15c6-0372-4c51-9995-8397a05c4272 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.634605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921945d-503e-4f42-8c4b-da7a068b4a98 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.634936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.635997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.635997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.636203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.643379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.644000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.644287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.644675 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.645288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.647267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.667522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.669183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.710842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1116/2252] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:50 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:50.712075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.713043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1137/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:50.735435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.853775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9f6-7781-4c0a-aff6-5dc533ef8ac4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.872933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.874127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.874435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.874888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.875816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.879942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.933910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1117/2254] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:50 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:50.935463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:50.955339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3432e-2dcb-42c7-ac49-da2624a72def service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:50.972545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:50.973187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:50.973518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:50.973802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:50.974513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:50.979189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:50.999360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1138/2255] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:51.000645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:51.019713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2a50-5c07-4d6a-87b3-ff37a67022c7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:51.025369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:51.025989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.026272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.026548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.027262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:51.030100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c52a-2811-47ff-a5f8-6559ff454cc0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:51.045138 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1118/2256] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:51.046987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:51.060089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a99b-4a3d-4328-a5f2-a46a4adb4ac1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:51.067278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:51.068260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.068809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.069305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] PATH_INFO: `/v3/projects/ea1e0664490b423d831ff7581ceeb75c/users/f81f488391da4377b820b3d76b1e4000/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.090925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1e0664490b423d831ff7581ceeb75c, user_id=f81f488391da4377b820b3d76b1e4000, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:51.096298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:51.167223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1139/2257] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:51 2022] PUT /identity/v3/projects/ea1e0664490b423d831ff7581ceeb75c/users/f81f488391da4377b820b3d76b1e4000/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:51.168808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.169305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.169718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.268549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] MFA Rules not processed for user `f81f488391da4377b820b3d76b1e4000`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:51.273847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:51.308952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:51.310936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:51.419516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1119/2258] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:51.432943 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:51.434427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:51.443337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b2c0-85c9-484a-8418-efae024c6b26 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:51.450290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:51.451424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.451766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.452042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] PATH_INFO: `/v3/projects/3c8c9282cce24f69be77dc3444cd6f11` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.453976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8c9282cce24f69be77dc3444cd6f11)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:51.455948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:51.464639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:51.505421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4973f9-16db-4d10-a9d9-0c4694ab795c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:51.521834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8c9282cce24f69be77dc3444cd6f11', 'request_id': 'req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.528500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8c9282cce24f69be77dc3444cd6f11', 'request_id': 'req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.541436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8c9282cce24f69be77dc3444cd6f11', 'request_id': 'req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.557748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:51.561987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] The token cache is being invalidate because project 3c8c9282cce24f69be77dc3444cd6f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:51.562521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.564722 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.566943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1140/2259] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:51 2022] DELETE /identity/v3/projects/3c8c9282cce24f69be77dc3444cd6f11 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:51.569177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:51.569806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.570089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.570390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.570997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:51.572219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:51.572660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:51.643825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2716c-2ec0-49b1-a4b0-5322a21a32c5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:51.644808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:51.646488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:51.648692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:51.649384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:51.649730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:51.650067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] PATH_INFO: `/v3/users/2b50ac156ebb42da8a22b4e48fef9e62` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:51.651277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b50ac156ebb42da8a22b4e48fef9e62)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:51.653277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:51.658328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1120/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:51.746469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b50ac156ebb42da8a22b4e48fef9e62'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.761860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b50ac156ebb42da8a22b4e48fef9e62'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.762786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b50ac156ebb42da8a22b4e48fef9e62'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.766448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b50ac156ebb42da8a22b4e48fef9e62'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.787354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b50ac156ebb42da8a22b4e48fef9e62'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:51.817137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1141/2261] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:51 2022] DELETE /identity/v3/users/2b50ac156ebb42da8a22b4e48fef9e62 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:52.187791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:52.208725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d21a-19d8-42b5-96c9-2e03d209ba01 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:52.307153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:52.308795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:52.309090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:52.309360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] PATH_INFO: `/v3/projects/9de89373f7d54b16b8357d7284d7793c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:52.310952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de89373f7d54b16b8357d7284d7793c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:52.313562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:52.384175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de89373f7d54b16b8357d7284d7793c', 'request_id': 'req-44519b2c-ce90-4f88-9cbe-93963b0378f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.395002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:52.396843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:52.406305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de89373f7d54b16b8357d7284d7793c', 'request_id': 'req-44519b2c-ce90-4f88-9cbe-93963b0378f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.413772 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcddb5-4636-4172-b156-286adeca9531 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:52.415190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de89373f7d54b16b8357d7284d7793c', 'request_id': 'req-44519b2c-ce90-4f88-9cbe-93963b0378f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.427377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:52.441346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] The token cache is being invalidate because project 9de89373f7d54b16b8357d7284d7793c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:52.442635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.443636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.447606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1121/2262] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:52 2022] DELETE /identity/v3/projects/9de89373f7d54b16b8357d7284d7793c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:52.451742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:52.454869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:52.505594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:52.536251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:52.537014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:52.537377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:52.537897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] PATH_INFO: `/v3/users/7e1b91a85430434c847a63dfed434852` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:52.540088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1b91a85430434c847a63dfed434852)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:52.543295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:52.564430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519b2c-ce90-4f88-9cbe-93963b0378f8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:52.571734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:52.573377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:52.573757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:52.574312 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] PATH_INFO: `/v3/users/7943dbba53014260b090cc98d20c135d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:52.575919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7943dbba53014260b090cc98d20c135d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:52.579319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:52.611774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1b91a85430434c847a63dfed434852'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.633447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1b91a85430434c847a63dfed434852'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.634980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1b91a85430434c847a63dfed434852'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.635653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1b91a85430434c847a63dfed434852'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.652954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8f173b1-5b1c-44a5-9f32-1e24e21f2b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1b91a85430434c847a63dfed434852'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.663446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7943dbba53014260b090cc98d20c135d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.666734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1142/2263] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:52 2022] DELETE /identity/v3/users/7e1b91a85430434c847a63dfed434852 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:52.672097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:52.672097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:52.672307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:52.674921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7943dbba53014260b090cc98d20c135d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.675879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7943dbba53014260b090cc98d20c135d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.676986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7943dbba53014260b090cc98d20c135d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.688221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7943dbba53014260b090cc98d20c135d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:52.692835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:52.694048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:52.711183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1122/2264] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:52 2022] DELETE /identity/v3/users/7943dbba53014260b090cc98d20c135d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:52.765416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1143/2265] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:52.778255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:52.781217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:52.856646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8448e-3691-49fa-aec6-9fc68b47e963 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:52.861361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:52.861985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:52.862434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:52.862549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:52.949099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:52.952840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:52.956481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80e1fa-c9d4-4b62-8fda-5176278b955d service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:52.972995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1123/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:53.132923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:53.134665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.152551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352143a-86fb-425b-a1fb-19dfd8a6cc4c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:53.172909 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:53.173982 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.175942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.176687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] PATH_INFO: `/v3/projects/43aaf1d178644c1da680c4694d74ab52` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.179240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43aaf1d178644c1da680c4694d74ab52)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:53.184480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:53.269531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:53.327727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43aaf1d178644c1da680c4694d74ab52', 'request_id': 'req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.335976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43aaf1d178644c1da680c4694d74ab52', 'request_id': 'req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.356510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43aaf1d178644c1da680c4694d74ab52', 'request_id': 'req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.385415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] The token cache is being invalidate because project 43aaf1d178644c1da680c4694d74ab52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:53.386277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.386987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.390936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1144/2267] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:53 2022] DELETE /identity/v3/projects/43aaf1d178644c1da680c4694d74ab52 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:53.397323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10cacc-e723-46e9-a18e-2f6994682a1e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.397786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10cacc-e723-46e9-a18e-2f6994682a1e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.398401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10cacc-e723-46e9-a18e-2f6994682a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.460159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1c10cacc-e723-46e9-a18e-2f6994682a1e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:53.461405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1c10cacc-e723-46e9-a18e-2f6994682a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.513076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:53.515225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.587100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1124/2268] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:53.590267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.590818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.591271 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.616534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:53.617967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.628654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1125/2269] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:53.629193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ba9-8f35-44f8-89d0-8a6da4512ff1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:53.636575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:53.637295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.637734 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.638021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] PATH_INFO: `/v3/projects/b0eb6de113e245ff90165445e3482aac` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.640431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0eb6de113e245ff90165445e3482aac)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:53.643125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:53.645070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:53.678124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31cfd2-cfc5-4f55-a947-e34e302130aa None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:53.685579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:53.686930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.687260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.687533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.688321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:53.688846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:53.692425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:53.721396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1126/2270] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:53.722902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:53.735369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e09bd-65e3-4550-8d4f-ed76dea40cf2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:53.755961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0eb6de113e245ff90165445e3482aac', 'request_id': 'req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.769362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0eb6de113e245ff90165445e3482aac', 'request_id': 'req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.797657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0eb6de113e245ff90165445e3482aac', 'request_id': 'req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.826211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] The token cache is being invalidate because project b0eb6de113e245ff90165445e3482aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:53.826540 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.835506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ef46caf-aa61-46c6-9e7c-9c32c7de2ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:53.840926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1145/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:53 2022] DELETE /identity/v3/projects/b0eb6de113e245ff90165445e3482aac => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:53.842519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9d85-0d68-4901-96fa-06878d8a1ce6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.844031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9d85-0d68-4901-96fa-06878d8a1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.844031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9d85-0d68-4901-96fa-06878d8a1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.867074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:53.868068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.868607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.869650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.870871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:53.873110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:53.882037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-755e9d85-0d68-4901-96fa-06878d8a1ce6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:53.883121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-755e9d85-0d68-4901-96fa-06878d8a1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.899801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1146/2272] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:53.901868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:53.902215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:53.903180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:53.934973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1127/2273] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:53.936732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:53.938587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:53.939550 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:53.940017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.007257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:54.047084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1147/2274] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:54.056159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.056593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fed0-1b02-496a-94e7-b82ce2aecaa8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.062940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.063645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.063875 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.064208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.064857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.067869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.072919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f2a56-7a26-4f6b-9d99-a46ed8b5e5be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.079902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:54.080837 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.081652 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.082003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.082662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.083960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:54.084421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.086259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.104288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1128/2275] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:53 2022] POST /identity/v3/users => generated 281 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:54.105314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.111773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1148/2276] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:54.113597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.126685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99965ec3-6f4d-4bcc-a0bf-75b9e193ed76 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.133757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.134620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.134978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.135350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.136068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.138252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.142016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582135-30c5-4f19-99bf-be828bd77ec0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.146697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.147398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.147688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.147957 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.148590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.149534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1129/2277] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:54.150981 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.153930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.165044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597225d-9008-4fc4-86ef-1c004176710a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.171082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.171750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.172039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.172309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.173296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.174921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.190115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1130/2278] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:54.190850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.201440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0900bc-1482-4008-bc71-342bfb6f305a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.202691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1149/2279] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:54 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:54.207180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.267906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.268578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.268854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.269134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] PATH_INFO: `/v3/projects/13aee9d172664c3fbfa4600f190e7046/users/a34de71d806944189d37b194eb7457f6/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.279064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cab2-6eba-4976-86c5-6c5a72363c88 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.284334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.284941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.285064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aee9d172664c3fbfa4600f190e7046, user_id=a34de71d806944189d37b194eb7457f6, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.285222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.285487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.286115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.288045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.288148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f867e-4d78-4282-9ea1-28df413370d7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.302638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1131/2280] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:54 2022] PUT /identity/v3/projects/13aee9d172664c3fbfa4600f190e7046/users/a34de71d806944189d37b194eb7457f6/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:54.311272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1150/2281] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:54 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:54.315222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.315620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.315928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.316230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.326019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19093c-000a-4e3b-92c0-41a23d914221 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.347614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] MFA Rules not processed for user `a34de71d806944189d37b194eb7457f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:54.348832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.390640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.391301 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.391665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.391902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.392584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.394280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.405416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1151/2282] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:14:54.409329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.414457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1132/2283] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:54.419968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacccc7-5335-4a19-ad99-28eadcc7f88a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.427000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.427636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.427911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.428178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.428817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.430533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.446806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1152/2284] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:54.448093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.450624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.453287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.461330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e023f6-9ddd-476d-8760-f93f66de0e0a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.466770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.468015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.468299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.468578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] PATH_INFO: `/v3/projects/6414053f42104d0db4783c64103651f9/users/7266f1599f9c4712b640b336e6a5f1a5/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.477867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:54.496314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6414053f42104d0db4783c64103651f9, user_id=7266f1599f9c4712b640b336e6a5f1a5, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.499497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241803c9-323f-49a1-8a67-fae0cce7bfa6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.515819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1133/2285] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:54 2022] PUT /identity/v3/projects/6414053f42104d0db4783c64103651f9/users/7266f1599f9c4712b640b336e6a5f1a5/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:54.528732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.529005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.529333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.544261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c48d-7565-4060-b464-c7d4dcbcff1c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.559585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] MFA Rules not processed for user `7266f1599f9c4712b640b336e6a5f1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:54.560934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.566411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:54.601318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.602018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.602198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.602470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.638557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1134/2286] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:54.651915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.653472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.665149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.665744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c598e-28b1-4cc9-910e-ef0687d57eb6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.666573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.669525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.670168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.670454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.670731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.675368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1153/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:54.679367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.681135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49231c92-b4fa-48b4-ac2c-cc2ac6064243 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.690781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1135/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:54.691480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:54.766511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fa972-cdad-4df4-8363-d0b5565d4717 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:54.774318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:54.774721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.775002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.775660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] PATH_INFO: `/v3/users/a34de71d806944189d37b194eb7457f6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.776821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34de71d806944189d37b194eb7457f6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:54.784550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:54.820023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:54.837439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34de71d806944189d37b194eb7457f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:54.846346 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34de71d806944189d37b194eb7457f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:54.847017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34de71d806944189d37b194eb7457f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:54.847786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34de71d806944189d37b194eb7457f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:54.861752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34de71d806944189d37b194eb7457f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:54.878757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1154/2289] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:54 2022] DELETE /identity/v3/users/a34de71d806944189d37b194eb7457f6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:54.883856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:54.884199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:54.884612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:54.908600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:54.909884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:54.992456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1136/2290] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:55.000645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.003059 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:55.073984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa07ba-a05c-406b-aac1-30a75bce68d0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.081270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.082027 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.082317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.083151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.101402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.105084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd90fb-5ffc-4e89-ae7d-6e6239c3f246 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.129833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1155/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:55.462842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.464410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:55.476929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec95f3-bec5-4e41-98cb-c6af8b229729 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.482107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.483359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.483893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.484212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] PATH_INFO: `/v3/projects/13aee9d172664c3fbfa4600f190e7046` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.485442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aee9d172664c3fbfa4600f190e7046)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.487666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.537948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aee9d172664c3fbfa4600f190e7046', 'request_id': 'req-5c2bba83-48d2-415f-9154-0174092332db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:55.546616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aee9d172664c3fbfa4600f190e7046', 'request_id': 'req-5c2bba83-48d2-415f-9154-0174092332db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:55.552716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aee9d172664c3fbfa4600f190e7046', 'request_id': 'req-5c2bba83-48d2-415f-9154-0174092332db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:55.566073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] The token cache is being invalidate because project 13aee9d172664c3fbfa4600f190e7046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:14:55.566361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:55.567073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5c2bba83-48d2-415f-9154-0174092332db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:55.568559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1137/2292] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:55 2022] DELETE /identity/v3/projects/13aee9d172664c3fbfa4600f190e7046 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:55.573383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.573845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.573937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.601515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:55.602751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:55.661172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1156/2293] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:55.668906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.669191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.669462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.689405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:55.690619 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:55.698483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1138/2294] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:55.702440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.712211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8fd7-4007-4209-9a42-21ba69736146 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.716826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.718240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.718516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.718785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.719454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:14:55.719755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.721337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.733337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1157/2295] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:14:55.737737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.746963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052045b-cfe8-4f53-a93c-86b1603f99da None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.751685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.752282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.752560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.752830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.753465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.755403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.764747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:55.784493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1139/2296] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:55.788662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.799306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401195c1-ec6b-45b7-a8e4-b572ce2a44c3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.843306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:55.865243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.865979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.866257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.866530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.867209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.869114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.894535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1158/2297] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:55 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:55.896021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.907114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304468d-c563-4d57-bd25-73567bf12fc7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.912791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.913733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.914014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.914280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.914925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.916561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.927173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1140/2298] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:55.931080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.940733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56913-eab2-42b0-972b-473a48ceca01 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.945238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.945829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.946104 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.946378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:55.947015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:55.948650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137d4a-4db5-4e20-b528-dc7dc129b905 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:55.961717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1159/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:55.962806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:55.975947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c423-a2e1-4ba8-8131-90441e7804ff admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:55.984278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:55.985309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:55.985765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:55.986213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] PATH_INFO: `/v3/projects/47c19fc83d56471fa44664837871a157/users/e60318ca73f3499d89cb80cd63c4cff2/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.006108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c19fc83d56471fa44664837871a157, user_id=e60318ca73f3499d89cb80cd63c4cff2, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.009474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.027461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1141/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:55 2022] PUT /identity/v3/projects/47c19fc83d56471fa44664837871a157/users/e60318ca73f3499d89cb80cd63c4cff2/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:56.041855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.042170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.042444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.089779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] MFA Rules not processed for user `e60318ca73f3499d89cb80cd63c4cff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:56.091169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:56.186969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.188794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1160/2301] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:56.252844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f8fdf-9c88-48db-82d6-05448b69c504 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.257430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.258045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.258324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.258590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.259286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.261226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.298149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1142/2302] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:14:56 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:14:56.299513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.319180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073628-db22-463d-b3c4-fcd67ca362d3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.385779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.386450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.386715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.387063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.387750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.391267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.418668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1161/2303] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:14:56 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:14:56.420881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.437107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b28c-bc2e-4030-9088-b1b17801a4ea admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.448519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.449135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.449449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.450066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.450514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.452794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.465092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1143/2304] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:56.469509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.498802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa91294-9cd8-4078-b51a-f4590d39b67b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.509372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.513018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.513318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.513570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] PATH_INFO: `/v3/projects/c7e830b9105944cbb3cb00d659523fd4/users/e5df19b0247448ee9ca9ab266783922b/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.546431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e830b9105944cbb3cb00d659523fd4, user_id=e5df19b0247448ee9ca9ab266783922b, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.546431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.556208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1162/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:56 2022] PUT /identity/v3/projects/c7e830b9105944cbb3cb00d659523fd4/users/e5df19b0247448ee9ca9ab266783922b/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:56.560437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.571003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7c30-16db-4ae2-aa66-f4bba75bc4ee admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.650961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.650961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.650961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.650961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.651709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.651709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56c6d-8dd5-42c4-b060-4f5ab628722e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.653999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1144/2306] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:14:56.658605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.670537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9708d1-e9cc-43a2-ae6f-36450231fbed admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.675246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.675904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.676188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.676461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] PATH_INFO: `/v3/projects/c7e830b9105944cbb3cb00d659523fd4/users/e5df19b0247448ee9ca9ab266783922b/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.678506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e830b9105944cbb3cb00d659523fd4, user_id=e5df19b0247448ee9ca9ab266783922b, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.681250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.688091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:56.693658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1163/2307] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:14:56 2022] PUT /identity/v3/projects/c7e830b9105944cbb3cb00d659523fd4/users/e5df19b0247448ee9ca9ab266783922b/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:56.705510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.705798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.706076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.734534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] MFA Rules not processed for user `e5df19b0247448ee9ca9ab266783922b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:56.735756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:56.747300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:56.803230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1145/2308] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:14:56.815100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:56.816735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:56.880739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c626a-21af-4560-b3f3-53140dd6c40e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:56.886278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:56.886880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:56.887190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:56.887462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:56.946361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:56.947824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aba4c-4ced-475b-bc8b-ec29f8f90783 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:56.956524 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1164/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:59.189650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.191313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.265728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b96cc-ef9a-4ca3-bb43-42bdad7f9b5f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:59.276487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:59.277435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.278048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.278603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] PATH_INFO: `/v3/users/6e97846704974c788301b02c5e114425` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.281290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e97846704974c788301b02c5e114425)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:59.283897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:59.334819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e97846704974c788301b02c5e114425'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.343599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e97846704974c788301b02c5e114425'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.344359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e97846704974c788301b02c5e114425'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.344882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e97846704974c788301b02c5e114425'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.351888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e97846704974c788301b02c5e114425'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.369403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1146/2310] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:59 2022] DELETE /identity/v3/users/6e97846704974c788301b02c5e114425 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:14:59.374509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.374998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.375212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.394949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:59.396158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.454700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1165/2311] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:59.464607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.465992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.496905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:59.527840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.529370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.537864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e7e2-d8ad-4eb6-ba95-9d1ff1523863 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:59.540728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321306-e7c8-4223-be4b-5f39775b454f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:59.541594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:59.542202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.542479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.542750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.545774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:59.546576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.546864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.547174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] PATH_INFO: `/v3/users/e60318ca73f3499d89cb80cd63c4cff2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.548323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60318ca73f3499d89cb80cd63c4cff2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:59.550505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:59.553110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:59.554863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d07b5-c2c0-4dfe-a6c3-a32c6ce51f7a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:59.565343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1147/2312] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:14:59.599628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60318ca73f3499d89cb80cd63c4cff2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.602662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:59.609131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60318ca73f3499d89cb80cd63c4cff2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.609817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60318ca73f3499d89cb80cd63c4cff2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.610577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60318ca73f3499d89cb80cd63c4cff2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.625819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60318ca73f3499d89cb80cd63c4cff2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:14:59.640091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1166/2313] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:59 2022] DELETE /identity/v3/users/e60318ca73f3499d89cb80cd63c4cff2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:14:59.644805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.645097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.645365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.666553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:14:59.667855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.737551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1148/2314] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:14:59.749862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.751532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.844831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce971-a435-4b16-88b2-01022ae1ee7b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:59.848515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:59.849135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.849413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.849687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.863951 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:59.866712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:59.890714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1167/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:14:59.922149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.923975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.938998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4248fe-7633-433b-a8e3-e01fc92563d7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:14:59.949566 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:14:59.951130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:14:59.951916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:14:59.953595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:14:59.953790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:14:59.954390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] PATH_INFO: `/v3/users/7266f1599f9c4712b640b336e6a5f1a5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:14:59.958378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7266f1599f9c4712b640b336e6a5f1a5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:14:59.964549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:14:59.993573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75837e-f58b-4dda-a020-12ac431eeb5d service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.011136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.011801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.012078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.012351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] PATH_INFO: `/v3/projects/949da098417a42c4870f51ce92360af2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.016249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949da098417a42c4870f51ce92360af2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.018439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.049533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7266f1599f9c4712b640b336e6a5f1a5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.061258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7266f1599f9c4712b640b336e6a5f1a5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.062015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7266f1599f9c4712b640b336e6a5f1a5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.062700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7266f1599f9c4712b640b336e6a5f1a5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.073521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-02b7fdb8-7132-4b1c-9e74-f6a3e53ac092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7266f1599f9c4712b640b336e6a5f1a5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.099453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949da098417a42c4870f51ce92360af2', 'request_id': 'req-af6d3ba4-6819-4bb5-ade7-998807d23a69'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.113958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949da098417a42c4870f51ce92360af2', 'request_id': 'req-af6d3ba4-6819-4bb5-ade7-998807d23a69'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.132406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949da098417a42c4870f51ce92360af2', 'request_id': 'req-af6d3ba4-6819-4bb5-ade7-998807d23a69'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.137350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1149/2316] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:14:59 2022] DELETE /identity/v3/users/7266f1599f9c4712b640b336e6a5f1a5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:00.141209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.141482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.141767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.161214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] The token cache is being invalidate because project 949da098417a42c4870f51ce92360af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:00.161515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.162201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af6d3ba4-6819-4bb5-ade7-998807d23a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.167913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1168/2317] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:14:59 2022] DELETE /identity/v3/projects/949da098417a42c4870f51ce92360af2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:00.172056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bacc2-f56f-4bd1-b83a-5e4de085ea95 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.172434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bacc2-f56f-4bd1-b83a-5e4de085ea95 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.172716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bacc2-f56f-4bd1-b83a-5e4de085ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.176839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:00.178080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.203587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-038bacc2-f56f-4bd1-b83a-5e4de085ea95 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:00.204794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-038bacc2-f56f-4bd1-b83a-5e4de085ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.254849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:00.274224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:00.281892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1150/2318] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:00.289172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.290723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.300869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1169/2319] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:00.309787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.310075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.311265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.345829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:00.348527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.373748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1170/2320] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:00.374292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c0cd-ee50-4a9f-b810-b56865df94db None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.378195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.385008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.385842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.386165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.386544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.391142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97fae2-5396-4fd6-925a-67642404cdd5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.418440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.418694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.419084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.419367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.419643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.421041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:15:00.421447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.421558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.424067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.438841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1151/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:15:00.439300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1171/2322] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:15:00.443367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.443608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.445056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.456465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7b0d-4886-4914-a995-28ef0ca8c51c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.463247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.464326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.464739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.465200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.466124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.467954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1fbe-707e-485a-82c0-cd52c95569b1 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.469701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.484273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.485449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.486188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.486629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] PATH_INFO: `/v3/projects/47c19fc83d56471fa44664837871a157` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.489176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c19fc83d56471fa44664837871a157)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.491399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.528910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1172/2323] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:00 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:00.533553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.605380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c19fc83d56471fa44664837871a157', 'request_id': 'req-5cd829a8-9369-49f4-a35e-06decb42d600'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.619610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c19fc83d56471fa44664837871a157', 'request_id': 'req-5cd829a8-9369-49f4-a35e-06decb42d600'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.633155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a1175-2f66-4bc7-850e-27905def0df2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.635103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c19fc83d56471fa44664837871a157', 'request_id': 'req-5cd829a8-9369-49f4-a35e-06decb42d600'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.656408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] The token cache is being invalidate because project 47c19fc83d56471fa44664837871a157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:00.657166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.662124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.667725 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1152/2324] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:00 2022] DELETE /identity/v3/projects/47c19fc83d56471fa44664837871a157 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:00.668806 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.677414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.780245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.781106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.781392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.781667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.782497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.784311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.795554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd829a8-9369-49f4-a35e-06decb42d600 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.801304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.801986 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.803756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.810821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] PATH_INFO: `/v3/users/e5df19b0247448ee9ca9ab266783922b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.812251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5df19b0247448ee9ca9ab266783922b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.814474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.829847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:00.834045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1173/2325] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:00 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:00.835273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.837084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.854130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1291-dc1f-4f70-8f5c-724881e978de admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.860181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.861378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.861916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.862800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.863662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.865655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.892213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5df19b0247448ee9ca9ab266783922b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.894972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1174/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:00.899189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.905000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5df19b0247448ee9ca9ab266783922b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.908302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5df19b0247448ee9ca9ab266783922b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.908950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5df19b0247448ee9ca9ab266783922b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.918279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9ba25-e8ec-4782-a020-01781b6bed06 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.922510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5df19b0247448ee9ca9ab266783922b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:00.924464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.925180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.925461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.925733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.926499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.928397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.942402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1175/2327] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:00.943083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.946635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.961976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024741-051a-4f37-9dc5-8811e4b6c495 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:00.966992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:00.967675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:00.968009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:00.968600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] PATH_INFO: `/v3/projects/6414053f42104d0db4783c64103651f9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:00.969450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6414053f42104d0db4783c64103651f9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:00.972593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:00.974716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1153/2328] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:00 2022] DELETE /identity/v3/users/e5df19b0247448ee9ca9ab266783922b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:00.976015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:00.977781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:00.999270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:01.038347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6414053f42104d0db4783c64103651f9', 'request_id': 'req-0feac8f9-d102-4705-85f1-91c086d7f9eb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.047628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6414053f42104d0db4783c64103651f9', 'request_id': 'req-0feac8f9-d102-4705-85f1-91c086d7f9eb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.067835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6414053f42104d0db4783c64103651f9', 'request_id': 'req-0feac8f9-d102-4705-85f1-91c086d7f9eb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.094793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] The token cache is being invalidate because project 6414053f42104d0db4783c64103651f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:01.095152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.096439 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0feac8f9-d102-4705-85f1-91c086d7f9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.099094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1176/2329] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:00 2022] DELETE /identity/v3/projects/6414053f42104d0db4783c64103651f9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:01.135103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfda29-6fea-4878-b70c-7f199776041d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:01.277243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:01.282539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.283541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.285156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] PATH_INFO: `/v3/projects/9160f929849c46eeb2fc8885f11658ba/users/be510308f0254f6db308faac479a4fa1/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.360229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9160f929849c46eeb2fc8885f11658ba, user_id=be510308f0254f6db308faac479a4fa1, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:01.371313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:01.408403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1154/2330] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:00 2022] PUT /identity/v3/projects/9160f929849c46eeb2fc8885f11658ba/users/be510308f0254f6db308faac479a4fa1/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:01.421606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.422045 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.422200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.475116 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] MFA Rules not processed for user `be510308f0254f6db308faac479a4fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:01.476431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:01.571891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:01.574881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:01.603590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1177/2331] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:01.616086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:01.621696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:01.635056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:01.751213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716ed-171a-4fb6-848f-3efd2bc70f31 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:01.756146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9ee24-f0eb-48c1-a4e8-431376d0891f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:01.757939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:01.758620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.758903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.759225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] PATH_INFO: `/v3/projects/c7e830b9105944cbb3cb00d659523fd4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.760374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e830b9105944cbb3cb00d659523fd4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:01.761382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:01.762462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.762585 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:01.762857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.763229 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.773120 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:01.774567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612628d8-00ff-44a5-87f9-4fbf2c04bddb service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:01.784750 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1178/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:01.817589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e830b9105944cbb3cb00d659523fd4', 'request_id': 'req-1e3e012d-261e-46d7-8295-d2751d01bcb2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.825557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e830b9105944cbb3cb00d659523fd4', 'request_id': 'req-1e3e012d-261e-46d7-8295-d2751d01bcb2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.832212 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e830b9105944cbb3cb00d659523fd4', 'request_id': 'req-1e3e012d-261e-46d7-8295-d2751d01bcb2'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.843432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] The token cache is being invalidate because project c7e830b9105944cbb3cb00d659523fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:01.843720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.845299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1e3e012d-261e-46d7-8295-d2751d01bcb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:01.846938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1155/2333] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:01 2022] DELETE /identity/v3/projects/c7e830b9105944cbb3cb00d659523fd4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:01.853133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.854089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.854440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.874840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:01.876114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:01.919186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:01.945774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1179/2334] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:01.954588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:01.954917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:01.955254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:01.976592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:01.977784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:01.987575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1156/2335] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:15:01.992205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.002601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d01f0d-04fc-487a-a18a-a0b56368ea8c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.008226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.008958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.009300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.009969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.010314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:15:02.010623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.012642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.024934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1180/2336] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:15:02.029746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.040360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55000762-a970-4b0e-aec5-09692cce77ce None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.055924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.055924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.055924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.055924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.056266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.056266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.080165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1157/2337] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:02 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:02.084513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.094583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d4cd-56d2-4216-9ba2-8d857d9e9bd0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.169710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.170886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.171206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.171478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.172193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.174855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.196219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1181/2338] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:02 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:02.200462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.211552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d970b-5ee0-40b0-90ce-4e56bfdf2c25 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.216348 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.217035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.217311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.217581 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.218228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.219882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.230111 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1158/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:02.234924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.245066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591fbf-ff49-4b0b-91f1-c7a68fb05ca0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.250445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.251095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.251382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.251655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.252294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.253875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c0d53-615a-46fa-b82f-f15624e6d6cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.264459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1182/2340] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:02.268424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.278786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3bc5e-56ff-4425-839e-ca6196e45f29 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.283489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.284134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.284414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.284690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] PATH_INFO: `/v3/projects/1b7e0f417b1143a6ae5777d9fa1961f1/users/73d4f26fc70a4ec699c77b85ca212c86/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.299354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7e0f417b1143a6ae5777d9fa1961f1, user_id=73d4f26fc70a4ec699c77b85ca212c86, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.301985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.314969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1159/2341] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:02 2022] PUT /identity/v3/projects/1b7e0f417b1143a6ae5777d9fa1961f1/users/73d4f26fc70a4ec699c77b85ca212c86/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:02.325010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f0f-59f7-498c-a643-952486ca9b98 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.325296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f0f-59f7-498c-a643-952486ca9b98 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.325573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f0f-59f7-498c-a643-952486ca9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.354326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8c062f0f-59f7-498c-a643-952486ca9b98 None None] MFA Rules not processed for user `73d4f26fc70a4ec699c77b85ca212c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:02.355546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8c062f0f-59f7-498c-a643-952486ca9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:02.419546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1183/2342] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:02.431149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:02.432850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:02.498904 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:02.506519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cbb2-5737-45ae-ad25-d9b366bf05a5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:02.511545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:02.512178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:02.512935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:02.513642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:02.526001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:02.528132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:02.543066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1160/2343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:04.124436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866611-f8d6-444a-a621-acfb282ca399 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:04.124913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866611-f8d6-444a-a621-acfb282ca399 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:04.125005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866611-f8d6-444a-a621-acfb282ca399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:04.144064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-22866611-f8d6-444a-a621-acfb282ca399 None None] MFA Rules not processed for user `73d4f26fc70a4ec699c77b85ca212c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:04.145252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-22866611-f8d6-444a-a621-acfb282ca399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:04.152195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1184/2344] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:04.410853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:04.412672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:04.532707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521792-b0da-4034-b4b6-59b1cb6129cb service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:04.549093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:04.549879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:04.550252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:04.550595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] PATH_INFO: `/v3/users/be510308f0254f6db308faac479a4fa1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:04.552151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be510308f0254f6db308faac479a4fa1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:04.554213 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:04.628420 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be510308f0254f6db308faac479a4fa1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:04.643069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be510308f0254f6db308faac479a4fa1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:04.643864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be510308f0254f6db308faac479a4fa1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:04.644586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be510308f0254f6db308faac479a4fa1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:04.659664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be510308f0254f6db308faac479a4fa1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:04.689865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1161/2345] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:04 2022] DELETE /identity/v3/users/be510308f0254f6db308faac479a4fa1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:04.691609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:04.691900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:04.692179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:04.711697 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:04.713140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:04.749714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:04.806253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1185/2346] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:04.813265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:04.815635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:04.929664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79611f88-3be2-4282-90ce-0b3161765b27 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:04.944266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:04.945169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:04.945822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:04.946284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:04.971703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:04.973415 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b122-36df-4c50-b726-58addbd09b3e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:04.995662 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1162/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:05.383991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:05.385829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:05.404135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4db89-edd3-4537-bbf0-651dd2a4782d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:05.417356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:05.434656 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:05.435250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:05.439509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] PATH_INFO: `/v3/projects/9160f929849c46eeb2fc8885f11658ba` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:05.445460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9160f929849c46eeb2fc8885f11658ba)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:05.453170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:05.553339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9160f929849c46eeb2fc8885f11658ba', 'request_id': 'req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:05.564133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9160f929849c46eeb2fc8885f11658ba', 'request_id': 'req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:05.574117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9160f929849c46eeb2fc8885f11658ba', 'request_id': 'req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:05.592423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] The token cache is being invalidate because project 9160f929849c46eeb2fc8885f11658ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:05.594084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:05.595914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78b3d4f2-b0ee-4aa8-a609-6589a0c93954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:05.598856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1186/2348] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:05 2022] DELETE /identity/v3/projects/9160f929849c46eeb2fc8885f11658ba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:05.603532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:05.604371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:05.604901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:05.645705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:05.651432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:05.668863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:05.743925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1163/2349] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:05.752966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:05.753259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:05.753538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:05.782497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:05.784041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:05.807371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1187/2350] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:05.808461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:05.821285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eab87c-0ee3-493b-bc9c-7743e7ba62c6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:05.827707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:05.828359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:05.828614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:05.828888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:05.829916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:15:05.830119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:05.832166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:05.848451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1164/2351] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:15:05.852935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:05.868563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7420e9-bc18-4ba6-9468-6127ff118fed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:05.883670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:05.884392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:05.884785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:05.885207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:05.886361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:05.899955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:05.969481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1188/2352] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:05 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:05.972101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:05.990292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c1e6-7cdf-4d07-84fe-9ab8906c9840 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.094166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.094345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.094780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.095275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.096745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.098535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.150955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1165/2353] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:05 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:06.155731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:06.167126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125796b-e4e7-4bd2-aae1-c1f02cdb5b04 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.173766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.174774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.175100 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.175389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.176188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.177822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.196393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1189/2354] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:06.197590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:06.209582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78be75-83f6-4bf9-8fcb-edd3401d9bf5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.217075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.217075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.217075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.217075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.217409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.219812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f1b18-045a-47cf-8d4d-2253246ea212 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.239665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1166/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:06.253092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:06.286859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757be8-34ad-4daf-a813-2cca72ee7a22 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.286859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.286859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.286859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.287326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] PATH_INFO: `/v3/projects/5d23ebdb8e8942b28db32911644bd58d/users/658292381ba8408d8ccee075f02ed865/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.298376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d23ebdb8e8942b28db32911644bd58d, user_id=658292381ba8408d8ccee075f02ed865, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.301275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.344831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1190/2356] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:06 2022] PUT /identity/v3/projects/5d23ebdb8e8942b28db32911644bd58d/users/658292381ba8408d8ccee075f02ed865/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:06.351228 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.351851 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.352537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.410264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] MFA Rules not processed for user `658292381ba8408d8ccee075f02ed865`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:06.413060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:06.613606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1167/2357] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:06.628588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:06.630797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:06.725223 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71004a9d-8710-4554-b4fd-b2b92f9a1b56 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.729299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.729935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.730205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.730482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.737970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:06.743128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.745002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cacb9b-1b9b-4572-8f8c-571f270dda80 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.763583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1191/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:06.790656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:06.800448 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:06.871131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285d22-0654-43b5-b88e-47bab72d5e3e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:06.878569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:06.879414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:06.880005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:06.880476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] PATH_INFO: `/v3/users/658292381ba8408d8ccee075f02ed865` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:06.882492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658292381ba8408d8ccee075f02ed865)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:06.887503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:06.968313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658292381ba8408d8ccee075f02ed865'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:06.986805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658292381ba8408d8ccee075f02ed865'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:06.988797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658292381ba8408d8ccee075f02ed865'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:06.989553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658292381ba8408d8ccee075f02ed865'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.000134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658292381ba8408d8ccee075f02ed865'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.027484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1168/2359] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:06 2022] DELETE /identity/v3/users/658292381ba8408d8ccee075f02ed865 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:07.032288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:07.032547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:07.032827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:07.055924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:07.057599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:07.162884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1192/2360] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:07.163504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:07.168116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:07.239884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03328c83-e490-4f16-b55a-33abd5c29fd6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:07.252634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:07.254365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:07.254365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:07.254365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:07.269628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:07.271419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977bd1-067b-43b5-9d69-3f096ce37711 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:07.299127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1169/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:15:07.736476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:07.739117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:07.765198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dbffd-8e4c-42b0-a2b1-8dccf07365a7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:07.773868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:07.774689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:07.776192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:07.776571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] PATH_INFO: `/v3/projects/5d23ebdb8e8942b28db32911644bd58d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:07.784176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d23ebdb8e8942b28db32911644bd58d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:07.786492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:07.894302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d23ebdb8e8942b28db32911644bd58d', 'request_id': 'req-2ee604a1-dd96-452f-8969-b4aed8bfe743'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.901338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d23ebdb8e8942b28db32911644bd58d', 'request_id': 'req-2ee604a1-dd96-452f-8969-b4aed8bfe743'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.916163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d23ebdb8e8942b28db32911644bd58d', 'request_id': 'req-2ee604a1-dd96-452f-8969-b4aed8bfe743'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.930545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] The token cache is being invalidate because project 5d23ebdb8e8942b28db32911644bd58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:07.930941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.931896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ee604a1-dd96-452f-8969-b4aed8bfe743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:07.937416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1193/2362] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:07 2022] DELETE /identity/v3/projects/5d23ebdb8e8942b28db32911644bd58d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:10.504838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.505338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.505338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.507019 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1170/2363] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:15:10.518420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2f37-ae93-4747-b4c3-464303107e4f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.518850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2f37-ae93-4747-b4c3-464303107e4f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.519135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2f37-ae93-4747-b4c3-464303107e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.540356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5a5b2f37-ae93-4747-b4c3-464303107e4f None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:10.541573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a5b2f37-ae93-4747-b4c3-464303107e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:10.585918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:10.588938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:10.619641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1194/2364] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:10.626753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:10.635201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffdce0-991f-4bb9-a6d0-5ab03371789c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.635201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffdce0-991f-4bb9-a6d0-5ab03371789c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.635201 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffdce0-991f-4bb9-a6d0-5ab03371789c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.637035 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1195/2365] 10.222.0.20 () {54 vars in 961 bytes} [Mon Sep 12 14:15:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 14:15:10.652219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.656022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.656369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.675859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be5a6-90cf-42b9-a893-bb3bc6bb0ec4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:10.680343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] MFA Rules not processed for user `faa6ff05a95b47628fb5208f4b021948`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:10.680472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:10.681018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.681303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.681537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:10.681657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] PATH_INFO: `/v3/users/4347a470a016477facc122c4c21f9820` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.682703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4347a470a016477facc122c4c21f9820)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:10.684683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:10.690455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1196/2366] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Sep 12 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:10.700325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:10.710696 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69fbb3-dacf-4107-8076-d7204797d2a5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:10.721000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:10.721770 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:10.722118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:10.722462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:10.727971 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:10.733606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:10.734384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4347a470a016477facc122c4c21f9820'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:10.735908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:10.741713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4347a470a016477facc122c4c21f9820'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:10.742395 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4347a470a016477facc122c4c21f9820'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:10.743193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4347a470a016477facc122c4c21f9820'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:10.746877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1197/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:15:10.751235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4347a470a016477facc122c4c21f9820'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:10.775764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1171/2368] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:10 2022] DELETE /identity/v3/users/4347a470a016477facc122c4c21f9820 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:11.044846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.055744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1719b-cb7c-477c-9f05-c3e5a43e519d service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:11.131579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:11.132275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.132554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.132827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] PATH_INFO: `/v3/projects/56df8c20a4504100b2784c6c694af845` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.133959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56df8c20a4504100b2784c6c694af845)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:11.135908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:11.186205 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56df8c20a4504100b2784c6c694af845', 'request_id': 'req-f165a5a5-7b61-4089-a985-d0386491a924'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.191884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56df8c20a4504100b2784c6c694af845', 'request_id': 'req-f165a5a5-7b61-4089-a985-d0386491a924'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.204469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56df8c20a4504100b2784c6c694af845', 'request_id': 'req-f165a5a5-7b61-4089-a985-d0386491a924'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.216283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] The token cache is being invalidate because project 56df8c20a4504100b2784c6c694af845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:11.216579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.217228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.219639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1198/2369] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:11 2022] DELETE /identity/v3/projects/56df8c20a4504100b2784c6c694af845 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:11.223375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.224954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:11.238561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118d6b-1951-4e62-9bbe-0a8c1e0cc998 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:11.299042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:11.299703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.299984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.300270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] PATH_INFO: `/v3/users/e7bf6c9cdb9e497a82a870476c28e075` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.301379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bf6c9cdb9e497a82a870476c28e075)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:11.303343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:11.349825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bf6c9cdb9e497a82a870476c28e075'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.352375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:11.359208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bf6c9cdb9e497a82a870476c28e075'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.360169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bf6c9cdb9e497a82a870476c28e075'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.361161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bf6c9cdb9e497a82a870476c28e075'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.368882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a687d080-d798-4cb9-b046-f7b07a990535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bf6c9cdb9e497a82a870476c28e075'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.386426 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1172/2370] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:11 2022] DELETE /identity/v3/users/e7bf6c9cdb9e497a82a870476c28e075 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:11.558854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.560651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:11.578101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a5a5-7b61-4089-a985-d0386491a924 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:11.637403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:11.638041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.638323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.638601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] PATH_INFO: `/v3/projects/053ec91d00d64958815b5839ba07113e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.639810 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053ec91d00d64958815b5839ba07113e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:11.641744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:11.674528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:11.693086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053ec91d00d64958815b5839ba07113e', 'request_id': 'req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.699593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053ec91d00d64958815b5839ba07113e', 'request_id': 'req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.710287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053ec91d00d64958815b5839ba07113e', 'request_id': 'req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.722372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] The token cache is being invalidate because project 053ec91d00d64958815b5839ba07113e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:11.722663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.723451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2b57fd80-fc78-4f46-8cd4-7cc43df4a5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:11.724947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1199/2371] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:11 2022] DELETE /identity/v3/projects/053ec91d00d64958815b5839ba07113e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:11.729895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.730400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.730523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.750052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:11.751284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:11.811620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1173/2372] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:11.819958 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.820270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.820545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.840879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:11.842993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:11.851771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1200/2373] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:11.855916 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.865905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bce065-cf86-4319-b0a7-1c6c237d7d2d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:11.870467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:11.871091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.871370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.871647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.872288 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:15:11.872586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:11.874176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:11.890145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1174/2374] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:15:11.893851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.903206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1ba8e-a4f1-44c7-9582-27c03dd2ad9a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:11.908999 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:11.909172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:11.909443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:11.909716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:11.910343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:11.912261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:11.941822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1201/2375] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:11 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:11.945935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:11.956735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d56f5-ddb1-4eb5-820f-5be156eb3b9a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.016313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.016923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.017202 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.017471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.018172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.020520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.049505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1175/2376] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:11 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:12.053947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.065473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57551b-d231-42b7-8bbd-d5a59e249c08 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.071212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.071933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.072228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.072740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.073948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.076068 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.087121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1202/2377] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:12.091056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.102112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498ca2-2017-4640-bda6-b245fec2ddcf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.107808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.108699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.108975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.109239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.109912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.111718 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed022-34f0-4cae-933c-bb60cbc0f05d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.123889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1176/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:15:12.128478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.138646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1829f-0e0a-4780-8187-064db0416d59 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.147686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.148559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.148914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.149300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] PATH_INFO: `/v3/projects/b95943d202f4438a87acc68e5c4490a8/users/b2ab748aa6b146ae9e78987d525fc087/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.165442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95943d202f4438a87acc68e5c4490a8, user_id=b2ab748aa6b146ae9e78987d525fc087, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.168134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.188321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1203/2379] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:12 2022] PUT /identity/v3/projects/b95943d202f4438a87acc68e5c4490a8/users/b2ab748aa6b146ae9e78987d525fc087/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:12.198649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.198938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.199252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.231792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] MFA Rules not processed for user `b2ab748aa6b146ae9e78987d525fc087`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:12.233132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:12.253424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:12.304324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1177/2380] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:12.305397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.375551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbcc2-4d0f-4d48-be0b-b87257d9fa6e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.380427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.381041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.381319 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.381591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.382227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.384365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.416996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1204/2381] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:12 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:15:12.418253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.431803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fe3d-a63e-4a9b-bdd5-82916afd31e3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.502112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.502726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.503001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.503298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.504065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.506104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.531537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1178/2382] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:12 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:12.542855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.554326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbae2-6cbe-4fbc-b506-3ce2579c3419 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.559193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.559774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.560055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.560326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.560969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.563167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.575574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1205/2383] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:12.579630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.589921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc814f-5051-4c3d-8ae8-4081f3afa916 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.594791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.595831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.597169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.597169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] PATH_INFO: `/v3/projects/39d7ae54ad30422888d7c7a578251021/users/a7135aa6d236478e8c4b77e58414a36a/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.618880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d7ae54ad30422888d7c7a578251021, user_id=a7135aa6d236478e8c4b77e58414a36a, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.621630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.635881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1179/2384] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:12 2022] PUT /identity/v3/projects/39d7ae54ad30422888d7c7a578251021/users/a7135aa6d236478e8c4b77e58414a36a/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:12.640063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.650762 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf18b-5893-481d-a185-289894032c87 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.673056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:12.714444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.715216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.715505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.715785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.716442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.718037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c15f8-b136-4a75-87ad-41a9e73f8389 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.727870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1206/2385] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:12.732995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.743968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957e3c-7a8e-45c7-8408-7c62c4c0a896 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.748602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.749251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.750067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.750341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] PATH_INFO: `/v3/projects/39d7ae54ad30422888d7c7a578251021/users/a7135aa6d236478e8c4b77e58414a36a/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.752247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d7ae54ad30422888d7c7a578251021, user_id=a7135aa6d236478e8c4b77e58414a36a, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:12.754881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:12.765532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1180/2386] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:12 2022] PUT /identity/v3/projects/39d7ae54ad30422888d7c7a578251021/users/a7135aa6d236478e8c4b77e58414a36a/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:12.775876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.776234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.776507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.805870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] MFA Rules not processed for user `a7135aa6d236478e8c4b77e58414a36a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:12.807122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:12.881254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1207/2387] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:12.895716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:12.898072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:12.956422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ededbfa-f741-4c00-aeb6-2f34ae1c97ed admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:12.960029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:12.960633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:12.960908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:12.961185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:12.993938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:13.027599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:13.029041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:13.038421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1181/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:17.352336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:17.362764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e93b-bd51-4a0e-bac0-da2be1209580 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:17.366298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:17.366887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:17.367203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:17.367475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:17.376141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:17.377539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73415-2cdf-4acc-bc40-188c038b13a2 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:17.386683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1208/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:22.277992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:22.339197 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edf85e-0b2d-436b-a460-c1cdcc530fc1 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:22.344374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:22.345006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:22.345287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:22.345587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] PATH_INFO: `/v3/users/b2ab748aa6b146ae9e78987d525fc087` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:22.346724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ab748aa6b146ae9e78987d525fc087)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:22.348702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:22.394242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ab748aa6b146ae9e78987d525fc087'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.401544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ab748aa6b146ae9e78987d525fc087'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.402158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ab748aa6b146ae9e78987d525fc087'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.402764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ab748aa6b146ae9e78987d525fc087'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.410247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ab748aa6b146ae9e78987d525fc087'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.427354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1182/2390] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:22 2022] DELETE /identity/v3/users/b2ab748aa6b146ae9e78987d525fc087 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:22.431834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:22.432300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:22.432438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:22.453663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:22.454920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:22.525593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1209/2391] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:22.535483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:22.536923 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:22.589401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:22.593815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcdaee-7f3b-4a84-a705-377a51f0be3e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:22.599127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:22.599882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:22.600272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:22.600549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:22.610446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:22.611913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:22.621401 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1183/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:22.887962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:22.889469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:22.904503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbff561-bb81-416f-af2f-03315e300384 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:22.913005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:22.914318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:22.914603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:22.914964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] PATH_INFO: `/v3/projects/b95943d202f4438a87acc68e5c4490a8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:22.916031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95943d202f4438a87acc68e5c4490a8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:22.918001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:22.951239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:22.966246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95943d202f4438a87acc68e5c4490a8', 'request_id': 'req-c5f111c1-3606-4cfe-ad57-d9c57e556af9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.971768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95943d202f4438a87acc68e5c4490a8', 'request_id': 'req-c5f111c1-3606-4cfe-ad57-d9c57e556af9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.978812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95943d202f4438a87acc68e5c4490a8', 'request_id': 'req-c5f111c1-3606-4cfe-ad57-d9c57e556af9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.990434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] The token cache is being invalidate because project b95943d202f4438a87acc68e5c4490a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:22.990720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.991347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:22.992850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1210/2393] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:22 2022] DELETE /identity/v3/projects/b95943d202f4438a87acc68e5c4490a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:22.996895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:23.007218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e473f-3250-4a46-a770-8dcb584870c4 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:23.065325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:23.065967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.066245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.066518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] PATH_INFO: `/v3/users/a7135aa6d236478e8c4b77e58414a36a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.067683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7135aa6d236478e8c4b77e58414a36a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:23.069683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:23.123822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7135aa6d236478e8c4b77e58414a36a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.132160 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7135aa6d236478e8c4b77e58414a36a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.133017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7135aa6d236478e8c4b77e58414a36a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.133648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7135aa6d236478e8c4b77e58414a36a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.141399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7251ad65-83c1-49c9-9310-805472452a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7135aa6d236478e8c4b77e58414a36a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.160256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1184/2394] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:22 2022] DELETE /identity/v3/users/a7135aa6d236478e8c4b77e58414a36a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:23.557381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:23.559060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:23.573608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f111c1-3606-4cfe-ad57-d9c57e556af9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:23.634514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:23.635188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.635478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.635751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] PATH_INFO: `/v3/projects/39d7ae54ad30422888d7c7a578251021` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.639334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d7ae54ad30422888d7c7a578251021)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:23.641807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:23.691040 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d7ae54ad30422888d7c7a578251021', 'request_id': 'req-314301e9-12d8-403e-837e-52f07f472f13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.699157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d7ae54ad30422888d7c7a578251021', 'request_id': 'req-314301e9-12d8-403e-837e-52f07f472f13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.708016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d7ae54ad30422888d7c7a578251021', 'request_id': 'req-314301e9-12d8-403e-837e-52f07f472f13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.719818 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] The token cache is being invalidate because project 39d7ae54ad30422888d7c7a578251021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:23.720110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.720743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-314301e9-12d8-403e-837e-52f07f472f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:23.722252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1211/2395] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:23 2022] DELETE /identity/v3/projects/39d7ae54ad30422888d7c7a578251021 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:23.729899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.730354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.730445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.753766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:23.754983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:23.840682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1185/2396] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:23.850607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.851065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.851523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.871985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:23.873184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:23.884466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1212/2397] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:23.889309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:23.900876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bda2-0dfa-42e4-af06-b56fbf91a145 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:23.907053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:23.907661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.907938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.908211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.908963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:15:23.909164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:23.910850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:23.918788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:23.930317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1186/2398] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:15:23.931089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:23.942938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ffa5-c284-4841-902c-72605bc47632 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:23.947929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:23.948721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:23.949166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:23.949440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:23.950087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:23.952141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:23.986939 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1213/2399] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:23 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:15:23.988465 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:23.999372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f98b-c07e-4c28-848b-89a0faf64a5c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:24.064690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:24.065295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.065575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.065983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.066657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:24.069399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:24.095500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1187/2400] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:23 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:15:24.110517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:24.125318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659ccc4-bae9-4ca6-8b25-df430987326c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:24.131807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:24.132362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.132654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.132891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.133691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:24.135580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:24.148128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1214/2401] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:24.151980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:24.167749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be731-27f3-4517-bb63-8d03cd8810e4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:24.173623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:24.174375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.174657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.174933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.175716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:24.177404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793fd4-1100-49f7-b5c3-a563e46d913a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:24.189333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1188/2402] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:24.193609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:24.203552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dabda-ac13-4463-99d0-a4aa3be7f1d9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:24.208164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:24.208805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.209084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.209359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] PATH_INFO: `/v3/projects/68023f4c973144a29bec392c8cfc6d79/users/55ea3f4fc31342a4b9f594bfd6ccfd68/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.211567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:24.226820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68023f4c973144a29bec392c8cfc6d79, user_id=55ea3f4fc31342a4b9f594bfd6ccfd68, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:24.229556 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:24.246249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1215/2403] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:24 2022] PUT /identity/v3/projects/68023f4c973144a29bec392c8cfc6d79/users/55ea3f4fc31342a4b9f594bfd6ccfd68/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:15:24.251397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.251700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.251975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.272142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:24.273344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:24.335663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1189/2404] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:15:24.346164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:24.347900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:24.406666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60776ea-ed2d-42d1-9230-481d3c15d22d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:24.410470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:24.411263 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:24.411545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:24.411816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:24.421132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:24.423080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1609e9-8587-4f88-a875-f14b385388a3 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:24.432411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1216/2405] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:28.750194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:28.751705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:28.771016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af189da-50ef-47e1-8338-ecff74cd42f5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:28.777907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:28.778932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:28.779255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:28.779533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] PATH_INFO: `/v3/users/f81f488391da4377b820b3d76b1e4000` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:28.782071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81f488391da4377b820b3d76b1e4000)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:28.784624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:28.869930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81f488391da4377b820b3d76b1e4000'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:28.881210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81f488391da4377b820b3d76b1e4000'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:28.884186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81f488391da4377b820b3d76b1e4000'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:28.892790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81f488391da4377b820b3d76b1e4000'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:28.908547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-20856d3a-ec02-48fa-8704-d4e743e27ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81f488391da4377b820b3d76b1e4000'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:28.919532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:28.935830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1190/2406] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:28 2022] DELETE /identity/v3/users/f81f488391da4377b820b3d76b1e4000 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:28.940423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:28.941289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:28.941720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:28.955053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:28.955419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:28.955826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:28.973584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:28.975921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:28.998666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] MFA Rules not processed for user `55ea3f4fc31342a4b9f594bfd6ccfd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:29.000181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.088911 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1217/2407] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:29.127888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.132159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.148778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1191/2408] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:29.153012 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.154647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.172027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da6e0-1d18-4510-92b0-b51b788eccbc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.177681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.178301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.178579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.178980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.179850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.183195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.209511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a557bd9-3c1c-4efa-9b75-ca62fa008054 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.213880 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.214607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.214941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.215360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.224381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1192/2409] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:15:29 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:15:29.226920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.228568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.228674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.241225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1218/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:29.354440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ea417-bdbf-49c5-b567-117efcffdb13 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.361876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.362695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.362958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.363275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.364041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.366489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.394611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1193/2411] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:15:29 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:15:29.399274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.410293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea719ac3-bc6e-4c17-bd0c-41e5fbd12a26 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.423924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.424813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.425126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.425551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.426931 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.428567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.450961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.453272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1219/2412] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:15:29.465001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646f3e-f202-4bcd-ba0b-dbcb9fc1705c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.472849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.473539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.473823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.474105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] PATH_INFO: `/v3/projects/d30f152af62c411797040d627a47a04f/users/0df23e3c08404052ab4301c4b3e71de5/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.501587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30f152af62c411797040d627a47a04f, user_id=0df23e3c08404052ab4301c4b3e71de5, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.504756 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1bfbb-707c-4c61-ab46-2612861d5338 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.531103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.532543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1194/2413] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:29 2022] PUT /identity/v3/projects/d30f152af62c411797040d627a47a04f/users/0df23e3c08404052ab4301c4b3e71de5/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:29.543630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91532a7-3bd8-49eb-8f0a-e46f7efcf756 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.564105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:29.574267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.574630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.574832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.613845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:29.615518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.621417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.622450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.623234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.623667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.624497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.628184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.643269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:29.651056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1220/2414] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:15:29.652063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.654399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.670485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8b39-0323-4312-ab45-f8667483b9bb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.676052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.676676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.676847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.677127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] PATH_INFO: `/v3/projects/ea1e0664490b423d831ff7581ceeb75c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.678428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1e0664490b423d831ff7581ceeb75c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.681819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.705799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1195/2415] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:29.706898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.721149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e1f2-5e42-4c69-9a0b-f71a1b27248a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.729033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.729717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.729995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.730270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] PATH_INFO: `/v3/projects/d30f152af62c411797040d627a47a04f/users/0df23e3c08404052ab4301c4b3e71de5/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.732787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30f152af62c411797040d627a47a04f, user_id=0df23e3c08404052ab4301c4b3e71de5, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:29.736287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:29.749335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1196/2416] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:15:29 2022] PUT /identity/v3/projects/d30f152af62c411797040d627a47a04f/users/0df23e3c08404052ab4301c4b3e71de5/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:29.777944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1e0664490b423d831ff7581ceeb75c', 'request_id': 'req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:29.778547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:29.781953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:29.784859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1e0664490b423d831ff7581ceeb75c', 'request_id': 'req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:29.800171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1e0664490b423d831ff7581ceeb75c', 'request_id': 'req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:29.836493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] The token cache is being invalidate because project ea1e0664490b423d831ff7581ceeb75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:29.836929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:29.837759 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3f704cb-c074-47e7-b1a0-0fcef1ec7ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:29.839502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1221/2417] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:29 2022] DELETE /identity/v3/projects/ea1e0664490b423d831ff7581ceeb75c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:29.920955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d481-2974-4b38-ba09-dad2efe03caf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:29.930068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:29.931357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:29.931791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:29.932297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:29.939412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:30.033435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:30.035892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:30.047918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1197/2418] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:30.782528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d7fb-6b6f-4818-9b5f-43d3f92f0baf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:30.783012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d7fb-6b6f-4818-9b5f-43d3f92f0baf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:30.783165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d7fb-6b6f-4818-9b5f-43d3f92f0baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:30.855475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3247d7fb-6b6f-4818-9b5f-43d3f92f0baf None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:30.858489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3247d7fb-6b6f-4818-9b5f-43d3f92f0baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:30.877560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1222/2419] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:30.887267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:30.888958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:30.906473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cef80-a8df-4b66-abef-c6b2b0712141 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:30.913817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:30.914594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:30.916472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:30.916472 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:30.933048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:30.934985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:30.946055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1198/2420] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:31.362257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31795-b548-4209-8be1-36ede637c5e2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:31.362532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31795-b548-4209-8be1-36ede637c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:31.363176 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31795-b548-4209-8be1-36ede637c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:31.391124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c9e31795-b548-4209-8be1-36ede637c5e2 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:31.392415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9e31795-b548-4209-8be1-36ede637c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:31.401645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1223/2421] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:31.420965 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:31.437827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19bceb-c956-4dc3-a210-386d901628ed service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:31.444020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:31.445554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:31.445704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:31.446287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:31.461897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:31.463914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:31.487751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1199/2422] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:32.087392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199ead-5c3c-4d35-a0a5-5f1f3eef15d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:32.087964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199ead-5c3c-4d35-a0a5-5f1f3eef15d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:32.088154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199ead-5c3c-4d35-a0a5-5f1f3eef15d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:32.123536 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6b199ead-5c3c-4d35-a0a5-5f1f3eef15d6 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:32.128850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b199ead-5c3c-4d35-a0a5-5f1f3eef15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:32.149487 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1224/2423] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:32.165282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:32.179057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097425-16dd-4ea4-97a6-afcaec99ec4d service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:32.190053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:32.190689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:32.190973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:32.191295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:32.200618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:32.202257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:32.220002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1200/2424] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:33.847454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57788b6-cccd-4f40-b970-0ab7d0be1fd9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:33.847956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57788b6-cccd-4f40-b970-0ab7d0be1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:33.853031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57788b6-cccd-4f40-b970-0ab7d0be1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:33.888163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f57788b6-cccd-4f40-b970-0ab7d0be1fd9 None None] MFA Rules not processed for user `94374f8729b1437a8cd0e171d94faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:33.889544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f57788b6-cccd-4f40-b970-0ab7d0be1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:33.967133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1225/2425] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:34.741272 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:34.742746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:34.766163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:34.859455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75126fd4-9971-42cf-9178-a242207eff21 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:34.864526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:34.865435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:34.865963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:34.866394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] PATH_INFO: `/v3/users/73d4f26fc70a4ec699c77b85ca212c86` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:34.868331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d4f26fc70a4ec699c77b85ca212c86)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:34.870471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:34.945831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d4f26fc70a4ec699c77b85ca212c86'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:34.961378 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d4f26fc70a4ec699c77b85ca212c86'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:34.977873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d4f26fc70a4ec699c77b85ca212c86'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:34.980983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d4f26fc70a4ec699c77b85ca212c86'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:34.992850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d4f26fc70a4ec699c77b85ca212c86'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.025260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1201/2426] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:15:34 2022] DELETE /identity/v3/users/73d4f26fc70a4ec699c77b85ca212c86 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:35.026822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:35.027311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:35.027500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:35.055431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:35.057131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:35.076214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:35.162626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1226/2427] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:35.170041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:35.172880 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:35.275683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88b25-0873-4843-8cd3-7e6993aa24c8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:35.281393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:35.282285 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:35.282866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:35.283368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:35.299124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:35.300868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279ddfe-685b-422f-b127-990f71ae3fa8 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:35.322381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1202/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:35.550717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:35.552236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:35.576776 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52424890-bfd7-4f2f-8d34-ad0c43737873 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:35.590188 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:35.590946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:35.591315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:35.591588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] PATH_INFO: `/v3/projects/1b7e0f417b1143a6ae5777d9fa1961f1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:35.592805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7e0f417b1143a6ae5777d9fa1961f1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:35.594793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:35.666917 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7e0f417b1143a6ae5777d9fa1961f1', 'request_id': 'req-5743116f-53ad-4147-8633-9cd3e7a86c47'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.675258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7e0f417b1143a6ae5777d9fa1961f1', 'request_id': 'req-5743116f-53ad-4147-8633-9cd3e7a86c47'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.683801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7e0f417b1143a6ae5777d9fa1961f1', 'request_id': 'req-5743116f-53ad-4147-8633-9cd3e7a86c47'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.700472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] The token cache is being invalidate because project 1b7e0f417b1143a6ae5777d9fa1961f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:15:35.700943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.702090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:15:35.704316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1227/2429] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:15:35 2022] DELETE /identity/v3/projects/1b7e0f417b1143a6ae5777d9fa1961f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:15:36.827332 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534d58-0a2a-4fbf-8edb-4d7751737929 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:36.828434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534d58-0a2a-4fbf-8edb-4d7751737929 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:36.828531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534d58-0a2a-4fbf-8edb-4d7751737929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:36.859072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d7534d58-0a2a-4fbf-8edb-4d7751737929 None None] MFA Rules not processed for user `0df23e3c08404052ab4301c4b3e71de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:36.860614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d7534d58-0a2a-4fbf-8edb-4d7751737929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:36.897882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:36.951929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1203/2430] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:36.966389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:36.969468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:37.052710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743116f-53ad-4147-8633-9cd3e7a86c47 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:37.056468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:37.057376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:37.057508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:37.057791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:37.059614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:37.132112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:37.133669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:37.139092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:37.145859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1228/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:15:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:15:37.324862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58f7d-3b4c-4910-b1f0-cb5b264c8b99 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:37.325783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58f7d-3b4c-4910-b1f0-cb5b264c8b99 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:37.326268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58f7d-3b4c-4910-b1f0-cb5b264c8b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:37.351096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-87e58f7d-3b4c-4910-b1f0-cb5b264c8b99 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:37.352470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-87e58f7d-3b4c-4910-b1f0-cb5b264c8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:37.415290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1204/2432] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:37.429816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:37.431589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:37.507850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49167ebd-ffeb-42c6-96e2-fca73e33ea2a service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:37.516198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:37.517341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:37.517642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:37.517919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:37.531242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:37.532512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037ce8f-ec9d-4224-8221-37af72f96e24 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:37.541510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1229/2433] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:46.794677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:46.795235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:46.795337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:46.814481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] MFA Rules not processed for user `55ea3f4fc31342a4b9f594bfd6ccfd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:46.816113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:46.822868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1205/2434] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:15:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:47.538023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=32 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:48.892336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:48.893350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:48.893767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:48.923817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:15:48.925377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:15:48.935399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1230/2435] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:15:48.952477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:15:48.968503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c768811-bf47-48db-bd1b-f62e68c79344 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:15:48.974837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:15:48.975829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:15:48.976109 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:15:48.976631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:15:48.987263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:15:48.989152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e814-6af8-41b7-a089-d64b7d042f9e service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:15:48.998038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1206/2436] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:15:58.916271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:58.994380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=51 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:18.118712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:18.120146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:18.175119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bad5c-81b9-43c9-add9-78b671e0db3d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:18.178585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:18.179207 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:18.179486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:18.179754 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:18.188840 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:18.190247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:18.199480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1231/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:16:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:16:27.431901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:27.432459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:27.432459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:27.452113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:27.453411 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:27.461283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1207/2438] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:16:27.474143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:27.485862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485364-dff7-41fd-a630-a1d6756ff50a service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:27.490875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:27.491508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:27.491788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:27.492061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:27.500101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:27.502485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915782-3501-4d5e-8a61-fecd828527d3 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:27.510519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1232/2439] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:16:37.446692 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:37.506914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=32 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:40.082370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:40.083976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:40.157927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d6835-6399-42cb-b7d3-2c59132ab6d1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:40.162849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:40.163508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:40.163773 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:40.164046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:40.165771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:40.177526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:40.179126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb25883-71e2-41b2-9122-62f1e9974d54 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:40.189388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1208/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:16:42.618429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cc08-cbf2-4b6d-a477-6c507c5b983c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.619002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cc08-cbf2-4b6d-a477-6c507c5b983c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.619002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cc08-cbf2-4b6d-a477-6c507c5b983c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.620405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1233/2441] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:16:42.627680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4325c-a5fb-452f-993d-00af6883cc7e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.628174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4325c-a5fb-452f-993d-00af6883cc7e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.628454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4325c-a5fb-452f-993d-00af6883cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.651323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-85c4325c-a5fb-452f-993d-00af6883cc7e None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:42.652629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-85c4325c-a5fb-452f-993d-00af6883cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:42.722009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1209/2442] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:16:42.734579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cc08-cbf2-4b6d-a477-6c507c5b983c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:42.745359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cc08-cbf2-4b6d-a477-6c507c5b983c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:42.749398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:42.750029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.750310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.750584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.761062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:42.762522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981004-8bc7-40cf-afac-cf7a0807af3c service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:42.773455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1234/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:16:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:16:42.849029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.849393 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.849832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.851222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1210/2444] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:16:42.856806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75143-1e4a-46b8-a021-cc49212225e5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.857437 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75143-1e4a-46b8-a021-cc49212225e5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.857679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75143-1e4a-46b8-a021-cc49212225e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.877575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a4a75143-1e4a-46b8-a021-cc49212225e5 None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:42.878777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a4a75143-1e4a-46b8-a021-cc49212225e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:42.885731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1235/2445] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:16:42.897571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:42.899689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:42.913761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d27ce-8ecd-4905-9109-a1ca460f1e69 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:42.917635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:42.918798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:42.919103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:42.919380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:42.926804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:42.928297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa286-14b1-4c46-8fc3-b07161b33af5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:42.936150 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1211/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:16:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:16:43.054445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6903-ad46-4df9-b978-30c5887b9519 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:43.054803 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6903-ad46-4df9-b978-30c5887b9519 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:43.055213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6903-ad46-4df9-b978-30c5887b9519 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:43.056647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1236/2447] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:16:43.062096 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1098b-9ddd-4416-8a25-33117953d564 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:43.062456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1098b-9ddd-4416-8a25-33117953d564 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:43.062819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1098b-9ddd-4416-8a25-33117953d564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:43.083984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4ca1098b-9ddd-4416-8a25-33117953d564 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:43.085200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ca1098b-9ddd-4416-8a25-33117953d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:43.096715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1212/2448] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:16:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:16:43.114813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6903-ad46-4df9-b978-30c5887b9519 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:43.126184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6903-ad46-4df9-b978-30c5887b9519 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:43.129735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:43.130323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:43.130597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:43.130888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:43.142545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:43.144089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f49b8-5649-4083-aee6-69aaed70e2ec service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:43.156287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1237/2449] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:16:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:16:43.303567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:43.303855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:43.304127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:43.322981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] MFA Rules not processed for user `ab3052e5c0b64d758990d0b78f48a00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:43.324834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:43.380072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1213/2450] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:16:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:16:45.848841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6df7-aade-42f9-b845-691bb520b73a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:45.849323 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6df7-aade-42f9-b845-691bb520b73a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:45.849436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e6df7-aade-42f9-b845-691bb520b73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:45.869804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d03e6df7-aade-42f9-b845-691bb520b73a None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:16:45.871350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d03e6df7-aade-42f9-b845-691bb520b73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:16:45.879819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1238/2451] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:16:45.891614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:16:45.905844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b1a5-f745-4ed7-9b21-6f68e4a2b9e3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:16:45.911467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:16:45.912082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:16:45.912362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:16:45.912633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:16:45.919238 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:45.923494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:16:45.925131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:16:45.933523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1214/2452] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:16:55.864892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=18 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:55.930061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:12.320483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0404-fec5-4488-97b0-e7a9ce9df005 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:17:12.321060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0404-fec5-4488-97b0-e7a9ce9df005 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:17:12.321060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b0404-fec5-4488-97b0-e7a9ce9df005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:17:12.341225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef5b0404-fec5-4488-97b0-e7a9ce9df005 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:17:12.342414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef5b0404-fec5-4488-97b0-e7a9ce9df005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:17:12.349723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1239/2453] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:17:12.363105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:17:12.374118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280813-6e2e-4669-a053-373b88744df0 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:17:12.379156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:17:12.379803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:17:12.380087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:17:12.380363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:17:12.388545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:17:12.390130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138a3e-a5c1-4f7e-9f0a-ca0c8856b4aa service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:17:12.398353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1215/2454] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:17:22.334839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:22.394954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:41.682112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:17:41.682684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:17:41.682684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:17:41.702376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] MFA Rules not processed for user `94374f8729b1437a8cd0e171d94faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:17:41.703688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:17:41.757289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1240/2455] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:17:51.750805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=25 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:29.076823 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726b11-423c-4695-a008-60a277663c9f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:29.077342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726b11-423c-4695-a008-60a277663c9f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:29.077444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726b11-423c-4695-a008-60a277663c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:29.096000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e2726b11-423c-4695-a008-60a277663c9f None None] MFA Rules not processed for user `44aee5cd548b4973a79bb6e254bbd0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:18:29.097196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e2726b11-423c-4695-a008-60a277663c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:29.152446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1216/2456] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:18:29.193295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:18:29.194674 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:29.206265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e7a7-2b9c-42e1-8053-6e8aef444e72 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:18:29.209771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:18:29.210362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:29.210637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:29.210905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:29.213675 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:29.228362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:18:29.229813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:18:29.241725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1241/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:18:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:18:29.829576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726b11-423c-4695-a008-60a277663c9f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:18:29.839691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726b11-423c-4695-a008-60a277663c9f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:18:29.843211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:18:29.843812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:29.844093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:29.844384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:29.846060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:29.859406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:18:29.860885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:18:29.872066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1217/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:18:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:18:39.219109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:18:39.220533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:39.234788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e77ae-6162-4877-ac86-2300140ecaca service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:18:39.240190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:18:39.240774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:39.241046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:39.241314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:39.242934 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:39.252677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:18:39.254230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:18:39.262908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1242/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:18:39.867048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=31 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:45.302338 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:18:45.304512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:45.364315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ed2ab-2e14-442c-811c-65269fa5daf9 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:18:45.367846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:18:45.368636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:45.368920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:45.369192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:45.370949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:45.381953 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:18:45.383434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:18:45.393476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1218/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:18:49.259418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=12 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:55.388893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=26 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:59.345262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:18:59.367190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fd50-46a4-421c-ab21-184f8f38386a service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:18:59.379350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:18:59.379992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:18:59.380280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:18:59.380553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:18:59.391828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:18:59.404689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:18:59.407753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be584d-1217-479b-8aab-5d2b83298841 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:18:59.419329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1243/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:19:01.646562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:01.672317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9f38-69ed-4e82-8cd5-2a741bf4bc45 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:01.680657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:01.681538 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:01.681992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:01.682436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:01.684580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:01.699800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:01.701759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:01.727464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1219/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:09.272490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:09.273006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:09.273118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:09.293009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:09.294274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:09.301563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1244/2463] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:19:09.353777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:09.366310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec0eb-5179-42d5-ae1f-9b1b6531e552 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:09.371819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:09.372422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:09.372701 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:09.372973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:09.381966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:09.383693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffb18-b91f-4d44-b95d-93c478e5a6d6 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:09.392671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1220/2464] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:19:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:19:09.886067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:09.896184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152d75f-704a-4620-8b97-e563a17046f3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:09.900621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:09.901594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:09.902044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:09.902486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:09.904813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:09.983206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:09.985060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:09.996704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1245/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:10.915002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:10.915894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:10.916333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:10.941087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] MFA Rules not processed for user `ab3052e5c0b64d758990d0b78f48a00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:10.942883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:10.961445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1221/2466] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:19:11.451761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:11.461739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851fa60-a038-4685-89da-a7d978049f33 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:11.467805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:11.468721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:11.469214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:11.469603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:11.471672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:11.483737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:11.485197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:11.502117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1246/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:12.422779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:12.425714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:12.442606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936fa48-0093-4104-a3e6-05343b3724df None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:12.448207 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:12.449065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:12.449340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:12.449825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:12.451784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:12.465722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:12.467546 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:12.479539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1222/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:15.906261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:15.907738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:15.923272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf239-8ef3-4f5c-9f84-97cb2d2486cf service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:15.928078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:15.928720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:15.929685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:15.929962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] PATH_INFO: `/v3/users/94374f8729b1437a8cd0e171d94faf00` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:15.932538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94374f8729b1437a8cd0e171d94faf00)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:15.934641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.014643 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94374f8729b1437a8cd0e171d94faf00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.026592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94374f8729b1437a8cd0e171d94faf00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.027496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94374f8729b1437a8cd0e171d94faf00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.029113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94374f8729b1437a8cd0e171d94faf00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.046148 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b4e0e53-7931-4037-9efe-d1a08e7f5a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94374f8729b1437a8cd0e171d94faf00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.060668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1247/2469] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:19:15 2022] DELETE /identity/v3/users/94374f8729b1437a8cd0e171d94faf00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:16.287708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.299508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cdb2-dba0-4e12-aaa5-dc02e54fabce service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.368754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.369422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.369711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.370490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] PATH_INFO: `/v3/projects/90e0457f773f4097a8256b2bc1b530ee` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.371654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e0457f773f4097a8256b2bc1b530ee)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.373612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.424086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e0457f773f4097a8256b2bc1b530ee', 'request_id': 'req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.432274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e0457f773f4097a8256b2bc1b530ee', 'request_id': 'req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.438045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e0457f773f4097a8256b2bc1b530ee', 'request_id': 'req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.450136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] The token cache is being invalidate because project 90e0457f773f4097a8256b2bc1b530ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:19:16.450427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.451127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a5ffffc8-fa1d-49f8-8e14-ff92118bff4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:16.453154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1223/2470] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:19:16 2022] DELETE /identity/v3/projects/90e0457f773f4097a8256b2bc1b530ee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:16.457511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.457796 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.458079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.478767 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:16.480021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:16.510757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:16.552591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1248/2471] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:19:16.560703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.561124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.561769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.582484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:16.583736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:16.592216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1224/2472] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:19:16.596520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.607063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c6e2-318e-412e-a55f-1840f323a7fa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.611739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.612339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.612616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.612895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.613535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:19:16.613839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.615476 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.628023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1249/2473] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:19:16.632193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.641549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e93d8-c661-4818-b5c4-e4c5fb4bf708 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.646515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.647254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.647531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.647796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.648930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.650818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.681400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1225/2474] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:19:16.683505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.693445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcff23-5125-4cd1-b526-6a5ce330fbb0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.759177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.760240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.760616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.761064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.761746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.764203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.796249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1250/2475] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:19:16 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:19:16.797631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.810507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717049bb-be7c-4376-9fb0-f1f134a2575b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.815592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.816425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.816857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.817293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.818114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.820853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.832785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1226/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:19:16.837427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.849450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f705c-8b3d-4f4c-98c1-d1c605b0b1af admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.855961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.856703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.857053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.858316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.858316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.860157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8534c7-4b52-4f96-909a-ff5209cd47d2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.875788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1251/2477] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:19:16.880262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:16.889931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:16.893515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f6504-f888-4b80-a53b-05b27dd66d38 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:16.900941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:16.902560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.903224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.904126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] PATH_INFO: `/v3/projects/157e042c633348adbae8bc5bbceca8fc/users/4d45164ec1f24346acba53d689c53376/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.923874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=157e042c633348adbae8bc5bbceca8fc, user_id=4d45164ec1f24346acba53d689c53376, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:16.927460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:16.954470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:16.955500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:16.955938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:16.958942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1227/2478] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:19:16 2022] PUT /identity/v3/projects/157e042c633348adbae8bc5bbceca8fc/users/4d45164ec1f24346acba53d689c53376/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:16.983685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:16.985109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:17.088230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1252/2479] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:19:17.097835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:17.099663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:17.166512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ae8-1795-4f80-94e4-02876ed3ff5d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:17.170427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:17.171171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:17.171524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:17.171865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:17.182151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:17.183705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:17.193526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1228/2480] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:19:19.870848 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:19.873235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:19.891302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4bcc-131c-41ab-a15c-e9679ea1f691 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:19.897298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:19.897992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:19.898299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:19.898592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] PATH_INFO: `/v3/users/55ea3f4fc31342a4b9f594bfd6ccfd68` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:19.900093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ea3f4fc31342a4b9f594bfd6ccfd68)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:19.902270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:19.964726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:19.979929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ea3f4fc31342a4b9f594bfd6ccfd68'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:19.992432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ea3f4fc31342a4b9f594bfd6ccfd68'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:19.994126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ea3f4fc31342a4b9f594bfd6ccfd68'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:19.994870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ea3f4fc31342a4b9f594bfd6ccfd68'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.011378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ea3f4fc31342a4b9f594bfd6ccfd68'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.031277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1253/2481] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:19:19 2022] DELETE /identity/v3/users/55ea3f4fc31342a4b9f594bfd6ccfd68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:19:20.394059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:20.427475 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dac92b-8b6a-4784-acbd-b9a38a0301a1 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:20.532589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:20.533384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:20.533850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:20.534313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] PATH_INFO: `/v3/projects/68023f4c973144a29bec392c8cfc6d79` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:20.535958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68023f4c973144a29bec392c8cfc6d79)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:20.539425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:20.594873 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68023f4c973144a29bec392c8cfc6d79', 'request_id': 'req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.604211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68023f4c973144a29bec392c8cfc6d79', 'request_id': 'req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.612364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68023f4c973144a29bec392c8cfc6d79', 'request_id': 'req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.627595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] The token cache is being invalidate because project 68023f4c973144a29bec392c8cfc6d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:19:20.627978 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.628729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.630486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1229/2482] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:19:20 2022] DELETE /identity/v3/projects/68023f4c973144a29bec392c8cfc6d79 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:20.635478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:20.636926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:20.653043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9f4e-38dd-4ce8-9114-f6ee1defac44 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:20.721336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:20.722142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:20.722521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:20.722892 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] PATH_INFO: `/v3/users/0df23e3c08404052ab4301c4b3e71de5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:20.724884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df23e3c08404052ab4301c4b3e71de5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:20.726984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:20.801079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df23e3c08404052ab4301c4b3e71de5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.813545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df23e3c08404052ab4301c4b3e71de5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.814465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df23e3c08404052ab4301c4b3e71de5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.815216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df23e3c08404052ab4301c4b3e71de5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.831992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2ca91a8e-7b60-45a9-9668-4a96af43ab9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df23e3c08404052ab4301c4b3e71de5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:20.852522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1254/2483] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:19:20 2022] DELETE /identity/v3/users/0df23e3c08404052ab4301c4b3e71de5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:21.074722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:21.076702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:21.103350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14b51a-78fa-42f8-b0c4-60f19ca15a81 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:21.115879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:21.203549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:21.207154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:21.207617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:21.208246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] PATH_INFO: `/v3/projects/d30f152af62c411797040d627a47a04f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:21.210187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30f152af62c411797040d627a47a04f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:21.212454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:21.282326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30f152af62c411797040d627a47a04f', 'request_id': 'req-6771f0cb-b672-4267-8fc5-fabdb3b42dca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:21.295441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30f152af62c411797040d627a47a04f', 'request_id': 'req-6771f0cb-b672-4267-8fc5-fabdb3b42dca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:21.305095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30f152af62c411797040d627a47a04f', 'request_id': 'req-6771f0cb-b672-4267-8fc5-fabdb3b42dca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:21.327402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] The token cache is being invalidate because project d30f152af62c411797040d627a47a04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:19:21.327784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:21.328520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:19:21.330330 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1230/2484] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:19:21 2022] DELETE /identity/v3/projects/d30f152af62c411797040d627a47a04f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:19:22.521865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:22.522408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:22.522408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:22.539222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:22.541445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:22.558551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] MFA Rules not processed for user `4d45164ec1f24346acba53d689c53376`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:22.559731 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:22.581181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:22.639099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f0cb-b672-4267-8fc5-fabdb3b42dca admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:22.647046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:22.648317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:22.648599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:22.649347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:22.650920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:22.653758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1255/2485] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:19:22.673889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:22.675595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863d937-5f5c-4857-9357-d035866ca31b service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:22.688987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1231/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:19:22.735657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:22.753279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0716faa-5efe-467c-956a-f9aac799f051 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:22.761103 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:22.761923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:22.762266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:22.762603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:22.791426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:22.793066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:22.813561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1256/2487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:24.480837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9027-678a-4513-9fd5-1da64d74be8c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:24.481316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9027-678a-4513-9fd5-1da64d74be8c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:24.481413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9027-678a-4513-9fd5-1da64d74be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:24.501232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-96ed9027-678a-4513-9fd5-1da64d74be8c None None] MFA Rules not processed for user `4d45164ec1f24346acba53d689c53376`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:19:24.502513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96ed9027-678a-4513-9fd5-1da64d74be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:24.509372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1232/2488] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:19:26.754390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:19:26.756809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:26.773537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a73c2-e82f-430b-9cd6-aa4dc7993b37 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:19:26.781251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:19:26.781993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:19:26.782334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:19:26.782544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:19:26.784839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:19:26.801139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:19:26.802732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:19:26.818831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1257/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:19:34.495441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:36.811272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=30 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:16.661200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:16.661743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:16.661743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:16.681100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:16.682327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:16.737344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1233/2490] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:20:16.785213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:16.786683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:16.856067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef9a0-5b05-4894-a49c-75b91b0b3a4d service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:16.860991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:16.861601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:16.861887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:16.862160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:16.870801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:16.872427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eeea3-4fca-4196-bddf-318b767a7120 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:16.880960 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1258/2491] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:26.730691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=25 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:26.877494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=32 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:30.757307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:30.759522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:30.813729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123553c-97a2-47c0-9ab6-2ac57c028743 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:30.817264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:30.817859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:30.818132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:30.818398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:30.820103 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:30.829929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:30.831417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613201a-389c-4a45-bf0f-4b033b82026e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:30.839412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1234/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:20:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:20:30.964559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:30.965706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:30.965994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:30.967390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1259/2493] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:20:30.973350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6e45-4e61-40d7-b3e8-c9fbf94ec75f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:30.973871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6e45-4e61-40d7-b3e8-c9fbf94ec75f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:30.974149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6e45-4e61-40d7-b3e8-c9fbf94ec75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:30.995558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b99c6e45-4e61-40d7-b3e8-c9fbf94ec75f None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:30.997080 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b99c6e45-4e61-40d7-b3e8-c9fbf94ec75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:31.007320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1235/2494] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:20:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:20:31.019521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:31.021546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:31.080816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b942-d380-4eb5-830e-36b1e4fa0d77 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:31.084475 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:31.085181 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.085459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.085728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.103313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:31.103313 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cc6d8-7068-4312-b796-5e751493fbe5 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:31.109587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1260/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:20:31.178519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096c35-f490-4ed4-acf9-3567887f5656 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.178722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096c35-f490-4ed4-acf9-3567887f5656 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.178992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096c35-f490-4ed4-acf9-3567887f5656 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.180384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1236/2496] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:20:31.185807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1f81-d222-4eb0-8aaf-911dd9df3633 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.186180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1f81-d222-4eb0-8aaf-911dd9df3633 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.186520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1f81-d222-4eb0-8aaf-911dd9df3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.206262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f3bd1f81-d222-4eb0-8aaf-911dd9df3633 None None] MFA Rules not processed for user `ad75668ae8ba47e7a3a2736e338c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:31.207512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f3bd1f81-d222-4eb0-8aaf-911dd9df3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:31.214151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1261/2497] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:20:31.226798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4096c35-f490-4ed4-acf9-3567887f5656 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:31.238321 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4096c35-f490-4ed4-acf9-3567887f5656 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:31.241812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:31.242402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.244013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.244313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.251602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:31.253028 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb33c52-2347-40e4-a9de-590d144a5cf2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:31.262093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1237/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:20:31.344787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.345077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.345372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.346718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1262/2499] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 12 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 14:20:31.351506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453043-63d9-430e-bc10-8b3d766bc5d0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.351790 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453043-63d9-430e-bc10-8b3d766bc5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.352060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20453043-63d9-430e-bc10-8b3d766bc5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.372079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-20453043-63d9-430e-bc10-8b3d766bc5d0 None None] MFA Rules not processed for user `c91855d376b741ef957a6352eedee1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:31.373297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-20453043-63d9-430e-bc10-8b3d766bc5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:31.391368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1238/2500] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 12 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:20:31.402132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:31.403856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:31.417671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4789c1-da49-4b95-b968-3c1aa52a377b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:31.421236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:31.421827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:31.422107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:31.422384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:31.432416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:31.433780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:31.444321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1263/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:20:33.094743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:33.095262 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:33.095385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:33.115060 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:33.116263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:33.123384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1239/2502] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:20:33.135217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:33.146204 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932eade0-aeac-4e10-bda3-f118a4a12dc1 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:33.151603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:33.152190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:33.152469 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:33.152745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:33.160545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:33.162106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fb8e6-1a32-4513-b3d4-a1b8ee22158d service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:33.170683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1264/2503] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:20:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:42.030296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:42.043948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f5a26-2727-46db-8436-052e73520f57 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:42.050030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:42.050674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:42.050932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:42.051236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:42.053299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:42.127940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:42.129707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:42.140320 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1240/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:20:43.167662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=41 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:52.135570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=69 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:56.135345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e42b-7bed-4623-a66f-107a14478c2b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:56.135854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e42b-7bed-4623-a66f-107a14478c2b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:56.135966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e42b-7bed-4623-a66f-107a14478c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:56.155403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ac89e42b-7bed-4623-a66f-107a14478c2b None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:20:56.156592 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac89e42b-7bed-4623-a66f-107a14478c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:20:56.163811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1265/2505] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:20:56.176721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:20:56.187911 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d47b-2edc-42bf-8376-142c8bb86ee2 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:20:56.192884 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:20:56.193497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:20:56.193779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:20:56.194172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:20:56.202361 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:20:56.203971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:20:56.212877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1241/2506] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:21:00.106924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:21:00.107502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:21:00.107502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:21:00.127580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] MFA Rules not processed for user `ab3052e5c0b64d758990d0b78f48a00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:21:00.129459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:21:00.136626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1266/2507] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:21:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:21:06.209517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:10.120710 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:57.110977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:21:57.112534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:21:57.269427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9d37-0a4a-4aa2-b40e-f9adafd6413b service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:21:57.274526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:21:57.275157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:21:57.275464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:21:57.275694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:21:57.278422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:21:57.289274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:21:57.290859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:21:57.300815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1242/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:01.944422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:01.968127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6705de-3bc9-4fd0-b964-f443782be5df None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:01.971883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:01.972485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:01.972764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:01.973037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:01.974740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:02.059726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:02.061164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:02.080706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1267/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:05.062494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.064616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:05.080158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d1b97-ed67-4c6f-af27-03e2f797861d service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.086768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.087425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.088216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.088495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.090540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:05.104615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.106379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.132025 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1243/2510] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:05.144383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.146483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:05.160808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1457-2865-48d2-9722-900bc1628a23 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.187420 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.188077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.188386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.188744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] PATH_INFO: `/v3/users/44aee5cd548b4973a79bb6e254bbd0f4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.189930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aee5cd548b4973a79bb6e254bbd0f4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.191914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.238867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aee5cd548b4973a79bb6e254bbd0f4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.246406 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aee5cd548b4973a79bb6e254bbd0f4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.247047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aee5cd548b4973a79bb6e254bbd0f4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.247617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aee5cd548b4973a79bb6e254bbd0f4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.259149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0342c965-da23-40f7-ac45-4ba51c02eba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aee5cd548b4973a79bb6e254bbd0f4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.271555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1268/2511] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:05 2022] DELETE /identity/v3/users/44aee5cd548b4973a79bb6e254bbd0f4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:05.441093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.454126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d81b2-394c-49c7-8cd1-9b4527ed32cc service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.518412 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.519072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.519354 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.519625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] PATH_INFO: `/v3/projects/c115b5aecf4e4cd9a62043c8c5883c0a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.520722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c115b5aecf4e4cd9a62043c8c5883c0a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.522629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.533632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:05.570127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c115b5aecf4e4cd9a62043c8c5883c0a', 'request_id': 'req-c61c81d3-9604-42fa-ac1b-642f6a877d54'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.577340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c115b5aecf4e4cd9a62043c8c5883c0a', 'request_id': 'req-c61c81d3-9604-42fa-ac1b-642f6a877d54'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.582765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c115b5aecf4e4cd9a62043c8c5883c0a', 'request_id': 'req-c61c81d3-9604-42fa-ac1b-642f6a877d54'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.595967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] The token cache is being invalidate because project c115b5aecf4e4cd9a62043c8c5883c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:05.596261 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.596918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c61c81d3-9604-42fa-ac1b-642f6a877d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:05.598389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1244/2512] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:05 2022] DELETE /identity/v3/projects/c115b5aecf4e4cd9a62043c8c5883c0a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:05.605288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.605802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.606111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.639258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:05.665495 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:05.667369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:05.724331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1269/2513] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:05.733222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.733506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.733782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.752976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:05.754177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:05.762035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1245/2514] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:05.766107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.776145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bd95-7c8f-4b2b-8b22-207543124664 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.780780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.781370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.781651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.781927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.782569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:05.782872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.784505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.795920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1270/2515] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:22:05.800278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.809740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60cf0c-663d-4948-a778-d0e72736580c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.814273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.814861 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.815174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.815444 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.816069 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.817956 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.844862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1246/2516] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:05 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:05.848862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.858885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b99-701f-484a-a869-5ff490933e98 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.916095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.916725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.917006 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.917278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.917913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.919876 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.942287 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1271/2517] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:05 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:05.946387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.957246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffea3-4d1a-44fc-9389-a3f8bd1c599e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.961984 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.962588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.962878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.963252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.963899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.965508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:05.975410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1247/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:05.979208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:05.989227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106dcf3-aebc-492f-9c7b-3af57c2a1351 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:05.993766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:05.994856 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:05.995171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:05.995448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:05.996081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:05.997660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c56d-1623-4f50-8704-83dc6978e8bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.008769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1272/2519] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:06.013073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.023620 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220322d-e094-4ef9-b411-45dfc3a52653 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.028239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.028896 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.029179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.029473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] PATH_INFO: `/v3/projects/a55f0f159f5e4d2e948d5796226765f6/users/2c974c00a1b04d9ba5e2df6842c4be67/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.045183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55f0f159f5e4d2e948d5796226765f6, user_id=2c974c00a1b04d9ba5e2df6842c4be67, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.047874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.064181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1248/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:06 2022] PUT /identity/v3/projects/a55f0f159f5e4d2e948d5796226765f6/users/2c974c00a1b04d9ba5e2df6842c4be67/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:06.076693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.076978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.077251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.105360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] MFA Rules not processed for user `2c974c00a1b04d9ba5e2df6842c4be67`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:06.106571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:06.157868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:06.176700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1273/2521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:06.181223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.251535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23979f-0230-41fa-baa0-a73e06148b14 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.256130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.256731 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.257009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.257280 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.257912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.259910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.286524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1249/2522] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:06 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:06.290677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.301741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4bba-0931-4149-873e-cf1b9596a730 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.357019 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.357633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.357916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.358190 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.358826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.360778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.381827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1274/2523] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:06.385847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.397708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a2a02-a0ad-4361-8f37-eb44a6469d49 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.402830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.403457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.403737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.404148 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.404788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.406558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.417595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1250/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:06.421867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.431579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2343e1-1573-446f-bcc7-0c6837272b39 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.436082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.436724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.437002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.437274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] PATH_INFO: `/v3/projects/2d68ea0ea7344c90bc6866568de18502/users/d9c77a52f8c748ebb4227f991c9d2044/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.451709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d68ea0ea7344c90bc6866568de18502, user_id=d9c77a52f8c748ebb4227f991c9d2044, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.454349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.467908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1275/2525] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:06 2022] PUT /identity/v3/projects/2d68ea0ea7344c90bc6866568de18502/users/d9c77a52f8c748ebb4227f991c9d2044/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:22:06.471804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.482500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4191c-4e48-47a3-b1b4-cffd5a022cd7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.487142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:06.539364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.539898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.540174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.540443 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.541079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.543241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c59ce-df20-4342-a1fd-a21cebf4e3cb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.552727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1251/2526] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:06.556849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.566843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea496-8c5d-405c-af13-b0e9ffb1fa33 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.571433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.572071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.572352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.572628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] PATH_INFO: `/v3/projects/2d68ea0ea7344c90bc6866568de18502/users/d9c77a52f8c748ebb4227f991c9d2044/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.574515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d68ea0ea7344c90bc6866568de18502, user_id=d9c77a52f8c748ebb4227f991c9d2044, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.577160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.586929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1276/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:06 2022] PUT /identity/v3/projects/2d68ea0ea7344c90bc6866568de18502/users/d9c77a52f8c748ebb4227f991c9d2044/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:06.598764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.599105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.599391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.627824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] MFA Rules not processed for user `d9c77a52f8c748ebb4227f991c9d2044`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:06.629027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:06.695608 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1252/2528] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:06.707296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:06.709005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:06.786370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada744-6708-48c6-a927-d63d2e3be219 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:06.790154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:06.790702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:06.790980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:06.791321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:06.800127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:06.801546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4d8ca-328c-4285-a2b2-7d265c48897c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:06.810883 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1277/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:07.199526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:07.288011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff586bb-1ce7-468e-8e93-b987babd02f2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:07.293282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:07.293914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:07.294195 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:07.294469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] PATH_INFO: `/v3/users/2c974c00a1b04d9ba5e2df6842c4be67` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:07.296056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c974c00a1b04d9ba5e2df6842c4be67)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:07.299705 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:07.334422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:07.347747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c974c00a1b04d9ba5e2df6842c4be67'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.355836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c974c00a1b04d9ba5e2df6842c4be67'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.356590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c974c00a1b04d9ba5e2df6842c4be67'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.357216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c974c00a1b04d9ba5e2df6842c4be67'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.363983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c974c00a1b04d9ba5e2df6842c4be67'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.380558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1253/2530] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:07 2022] DELETE /identity/v3/users/2c974c00a1b04d9ba5e2df6842c4be67 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:07.385056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:07.385516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:07.385613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:07.405380 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:07.406568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:07.425083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:07.465921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1278/2531] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:07.475421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:07.476789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:07.545658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39989fe-4a08-44ea-b371-b63146c7d878 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:07.549479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:07.550018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:07.550293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:07.550562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:07.559801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:07.561223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:07.570494 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1254/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:07.833575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:07.835149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:07.847758 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d7e72-66c0-413c-92f1-9c22d0d7de7c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:07.852679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:07.853600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:07.853878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:07.854147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] PATH_INFO: `/v3/projects/a55f0f159f5e4d2e948d5796226765f6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:07.855368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55f0f159f5e4d2e948d5796226765f6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:07.857265 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:07.903788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55f0f159f5e4d2e948d5796226765f6', 'request_id': 'req-181426d0-cad3-4d45-877d-9979ea2434bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.909333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55f0f159f5e4d2e948d5796226765f6', 'request_id': 'req-181426d0-cad3-4d45-877d-9979ea2434bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.916644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55f0f159f5e4d2e948d5796226765f6', 'request_id': 'req-181426d0-cad3-4d45-877d-9979ea2434bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.928299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] The token cache is being invalidate because project a55f0f159f5e4d2e948d5796226765f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:07.928648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.929494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:07.931351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1279/2533] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:07 2022] DELETE /identity/v3/projects/a55f0f159f5e4d2e948d5796226765f6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:07.935824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:07.945322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d5679-d67b-4f83-ba2b-7245b3ff7b73 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.000566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.001211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.001487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.001759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] PATH_INFO: `/v3/users/d9c77a52f8c748ebb4227f991c9d2044` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.002868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c77a52f8c748ebb4227f991c9d2044)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.004838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.047349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:08.050198 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c77a52f8c748ebb4227f991c9d2044'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.059648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c77a52f8c748ebb4227f991c9d2044'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.060268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c77a52f8c748ebb4227f991c9d2044'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.060899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c77a52f8c748ebb4227f991c9d2044'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.067955 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-debabfe0-4694-4d8d-a178-d903f03a895b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c77a52f8c748ebb4227f991c9d2044'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.085485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1255/2534] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:07 2022] DELETE /identity/v3/users/d9c77a52f8c748ebb4227f991c9d2044 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:08.347454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.348955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:08.365716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181426d0-cad3-4d45-877d-9979ea2434bd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.424099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.424780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.425016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.425289 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] PATH_INFO: `/v3/projects/2d68ea0ea7344c90bc6866568de18502` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.426405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d68ea0ea7344c90bc6866568de18502)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.428315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.473843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d68ea0ea7344c90bc6866568de18502', 'request_id': 'req-08648ba6-2333-463c-8bc8-6e9a256c4135'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.474989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:08.481247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d68ea0ea7344c90bc6866568de18502', 'request_id': 'req-08648ba6-2333-463c-8bc8-6e9a256c4135'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.488997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d68ea0ea7344c90bc6866568de18502', 'request_id': 'req-08648ba6-2333-463c-8bc8-6e9a256c4135'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.500396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] The token cache is being invalidate because project 2d68ea0ea7344c90bc6866568de18502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:08.500683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.501331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08648ba6-2333-463c-8bc8-6e9a256c4135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:08.502785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1280/2535] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:08 2022] DELETE /identity/v3/projects/2d68ea0ea7344c90bc6866568de18502 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:08.507668 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.508145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.508470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.527750 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:08.528925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:08.590234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1256/2536] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:08.597741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.598026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.598302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.618238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:08.620071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:08.627709 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1281/2537] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:08.631745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.641584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd97fe-6fc7-4c15-84ae-996d0dcc913f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.646115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.646714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.646989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.647289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.647928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:08.648224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.649816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.661528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1257/2538] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:08.665813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.675464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3e84-bec7-43ff-b43c-408d7c80fc52 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.679962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.680544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.680819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.681085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.681738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.683695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.711497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1282/2539] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:08 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:08.716229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.726071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd68b-9c23-44d7-bce8-6e857ca829dc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.785563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.786165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.786441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.786710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.787386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.789311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.812329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1258/2540] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:08 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:08.816547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.826690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb99b-bc9d-4f25-987a-1a0cae8e3dbc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.831284 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.831899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.832177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.832448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.833088 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.834669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.847648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1283/2541] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:08.851604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.862270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4dd56-f226-4d52-85b7-0836f1e070d8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.866885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.867512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.867789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.868058 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.868767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.870388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6edb-2c6e-45a1-810e-ec42d75279d3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.880710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1259/2542] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:08.884698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:08.894670 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072115a-bbf5-4784-8897-e3ae3b5df9ea admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:08.899363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:08.900024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.900304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.901097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] PATH_INFO: `/v3/projects/dda39db900ec4c9e8de32d9ba498a905/users/24f6e37a51a5486e929b554bb6bc9c5d/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.916849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda39db900ec4c9e8de32d9ba498a905, user_id=24f6e37a51a5486e929b554bb6bc9c5d, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:08.919548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:08.932422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1284/2543] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:08 2022] PUT /identity/v3/projects/dda39db900ec4c9e8de32d9ba498a905/users/24f6e37a51a5486e929b554bb6bc9c5d/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:08.942782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:08.943087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:08.943360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:08.971083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] MFA Rules not processed for user `24f6e37a51a5486e929b554bb6bc9c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:08.972294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:08.986167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:09.040563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1260/2544] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:09.045085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.106198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6434e38-6ffd-4d6d-9d7a-76cb3dd04761 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.110870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.111514 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.111801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.112599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.112695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.114597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.142361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1285/2545] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:09 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:09.146496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.157803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026249a1-ce59-4505-bbc7-7a8c8967abd6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.212744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.213879 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.214154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.214424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.215077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.217022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.237906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1261/2546] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:09.241839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.252060 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43958-c4eb-4ca1-9820-0cefb1d796d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.256842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.257441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.257774 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.258047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.258688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.260868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.271416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1286/2547] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:09.275221 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.285647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170af00-c908-4ab1-88ef-e445322c7918 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.290313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.290981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.291294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.291566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] PATH_INFO: `/v3/projects/51ca82e1c30c4650949b4e1833978565/users/cf81daf2b8a548e9bc3e3fbaec8150d8/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.305791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ca82e1c30c4650949b4e1833978565, user_id=cf81daf2b8a548e9bc3e3fbaec8150d8, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.308455 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.320561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1262/2548] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:09 2022] PUT /identity/v3/projects/51ca82e1c30c4650949b4e1833978565/users/cf81daf2b8a548e9bc3e3fbaec8150d8/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:09.324927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.334825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5bfc0-a87d-4bd6-9db1-a90be727f21a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.381365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:09.395394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.395995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.396272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.396544 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.397187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.398766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233d36-e613-4999-ba65-1611f485b83f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.409326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1287/2549] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:09.413517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.423736 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e0c95-3f70-4678-832f-bd8fda3e443e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.428429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.429073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.429353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.429647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] PATH_INFO: `/v3/projects/51ca82e1c30c4650949b4e1833978565/users/cf81daf2b8a548e9bc3e3fbaec8150d8/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.432094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ca82e1c30c4650949b4e1833978565, user_id=cf81daf2b8a548e9bc3e3fbaec8150d8, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.434746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.444691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1263/2550] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:09 2022] PUT /identity/v3/projects/51ca82e1c30c4650949b4e1833978565/users/cf81daf2b8a548e9bc3e3fbaec8150d8/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:09.456367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.456851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.457037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.484634 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] MFA Rules not processed for user `cf81daf2b8a548e9bc3e3fbaec8150d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:09.485833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:09.552768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1288/2551] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:09.564504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.566255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:09.623284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46aa0-d1d9-4a3f-819a-3861ad337d73 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.626890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.627511 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.627787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.628056 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.637446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.638802 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.647967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1264/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:09.723012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:09.732944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9cda-8418-4a9b-adb4-706bf9b3a8be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:09.736966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:09.737567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:09.737847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:09.738118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:09.793218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:09.794638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b00c5-868d-4b00-9829-50eb80f3c9e4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:09.803259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1289/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:12.513391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:12.525676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:12.575964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f7dfc-7479-4f03-ae80-f2c0a13313fe service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:12.580428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:12.581043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:12.581318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:12.581587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] PATH_INFO: `/v3/users/24f6e37a51a5486e929b554bb6bc9c5d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:12.582686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f6e37a51a5486e929b554bb6bc9c5d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:12.584638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:12.628817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f6e37a51a5486e929b554bb6bc9c5d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:12.635724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f6e37a51a5486e929b554bb6bc9c5d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:12.636362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f6e37a51a5486e929b554bb6bc9c5d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:12.637696 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f6e37a51a5486e929b554bb6bc9c5d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:12.644637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f6e37a51a5486e929b554bb6bc9c5d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:12.661847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1265/2554] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:12 2022] DELETE /identity/v3/users/24f6e37a51a5486e929b554bb6bc9c5d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:12.666350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:12.666807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:12.667130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:12.686133 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:12.687347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:12.745425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1290/2555] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:22:12.755563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:12.757059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:12.813754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d96a-c9cb-4e9e-a2fc-84179f46f12c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:12.817428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:12.818031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:12.818310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:12.818587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:12.827404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:12.828836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:12.837963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1266/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:13.099763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:13.101210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:13.115393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80cd31-302d-42bd-983e-b78a6dd151f4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:13.125799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:13.126570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.126925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.127298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] PATH_INFO: `/v3/projects/dda39db900ec4c9e8de32d9ba498a905` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.128581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda39db900ec4c9e8de32d9ba498a905)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:13.130945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:13.133927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:13.180387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda39db900ec4c9e8de32d9ba498a905', 'request_id': 'req-32ce939f-6592-4b91-b509-c624d2c26e52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.185844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda39db900ec4c9e8de32d9ba498a905', 'request_id': 'req-32ce939f-6592-4b91-b509-c624d2c26e52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.193079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda39db900ec4c9e8de32d9ba498a905', 'request_id': 'req-32ce939f-6592-4b91-b509-c624d2c26e52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.204374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] The token cache is being invalidate because project dda39db900ec4c9e8de32d9ba498a905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:13.204668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.205297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.206792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1291/2557] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:13 2022] DELETE /identity/v3/projects/dda39db900ec4c9e8de32d9ba498a905 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:13.210814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:13.221295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5485-c32c-4db1-b3c0-7b30817e3b12 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:13.250749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:13.281782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:13.282424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.282710 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.282994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] PATH_INFO: `/v3/users/cf81daf2b8a548e9bc3e3fbaec8150d8` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.284158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf81daf2b8a548e9bc3e3fbaec8150d8)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:13.286083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:13.332146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf81daf2b8a548e9bc3e3fbaec8150d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.338919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf81daf2b8a548e9bc3e3fbaec8150d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.339584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf81daf2b8a548e9bc3e3fbaec8150d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.340174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf81daf2b8a548e9bc3e3fbaec8150d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.347638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d74f474b-9f31-4ecd-8b0f-be3b1406ca00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf81daf2b8a548e9bc3e3fbaec8150d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.365313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1267/2558] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:13 2022] DELETE /identity/v3/users/cf81daf2b8a548e9bc3e3fbaec8150d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:13.630248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:13.631852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:13.645738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939f-6592-4b91-b509-c624d2c26e52 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:13.702411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:13.703058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.703342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.703616 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] PATH_INFO: `/v3/projects/51ca82e1c30c4650949b4e1833978565` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.704726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ca82e1c30c4650949b4e1833978565)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:13.706639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:13.752160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ca82e1c30c4650949b4e1833978565', 'request_id': 'req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.757716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ca82e1c30c4650949b4e1833978565', 'request_id': 'req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.765578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ca82e1c30c4650949b4e1833978565', 'request_id': 'req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.776705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] The token cache is being invalidate because project 51ca82e1c30c4650949b4e1833978565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:13.776990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.777599 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2badf3ed-caa4-412a-8e7e-ccf2eb34b7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:13.779745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1292/2559] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:13 2022] DELETE /identity/v3/projects/51ca82e1c30c4650949b4e1833978565 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:13.784838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.785322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.785421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.804604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:13.805788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:13.864258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1268/2560] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:13.872594 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.872869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.873141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.892841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:13.894128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:13.901886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1293/2561] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:13.906072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:13.915702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4287f6-b1fc-4599-a3b6-33f48f6a5aee None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:13.920317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:13.920919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.921201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.921480 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.922126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:13.922429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:13.924059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:13.936513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1269/2562] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:13.940720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:13.949702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5576-2d3e-41d0-803c-59a60d5f17e5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:13.954872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:13.955491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:13.955769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:13.956039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:13.956658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:13.958571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:13.972838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:13.986763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1294/2563] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:13 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:13.990789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.001399 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf13d7d-b776-41be-b238-76a60ab8d49f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.039181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:14.058909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.059537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.060304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.060570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.061893 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.063979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.084709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1270/2564] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:13 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:14.088785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.098962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c702-7684-44dd-ba59-5878b6e71030 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.104117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.104720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.105002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.105275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.105921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.107620 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.120860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1295/2565] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:14.122059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.132462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fc8e8-c9d0-4e1a-b3f8-d6bac4c986b3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.137077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.137666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.138537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.138807 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.139477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.141085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f66c9-a351-4d8b-b812-5b9bff31bf1c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.150895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1271/2566] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:14.154942 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.164912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a938af8-2bc3-45e8-9d09-2e7739de933f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.169769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.170466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.170747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.171017 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] PATH_INFO: `/v3/projects/bff96e9b7ef14b46847c10ab2c7d3885/users/591f1a564030413bacc71fd31eb9fb00/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.187927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff96e9b7ef14b46847c10ab2c7d3885, user_id=591f1a564030413bacc71fd31eb9fb00, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.190569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.204208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1296/2567] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:14 2022] PUT /identity/v3/projects/bff96e9b7ef14b46847c10ab2c7d3885/users/591f1a564030413bacc71fd31eb9fb00/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:14.216083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.216365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.216637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.244733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] MFA Rules not processed for user `591f1a564030413bacc71fd31eb9fb00`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:14.245936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:14.310881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1272/2568] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:14.315214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.375586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eea0a9-c806-49cc-a28a-ffbd0acbf4d8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.380189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.380785 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.381069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.381340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.381966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.383895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.412666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1297/2569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:14.416948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.428236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62bd2d-c05c-44df-b21a-1ffe6e36a756 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.484765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.485370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.485653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.485927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.486560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.488536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.512776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1273/2570] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:14 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:14.513945 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.524255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054086e1-5ac9-47fb-b9d9-96ea03e6dbe9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.528861 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.529461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.529744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.530018 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.530659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.532300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.542665 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1298/2571] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:14.547151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.557156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e293ac-15f1-41d2-8e8b-922ea079d441 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.562467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.563091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.563376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.563656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] PATH_INFO: `/v3/projects/da351d2284274c20a35e58c17297876f/users/a58a68bd913c46c2aee896d2f05f015d/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.579595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da351d2284274c20a35e58c17297876f, user_id=a58a68bd913c46c2aee896d2f05f015d, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.582267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.595543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1274/2572] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:14 2022] PUT /identity/v3/projects/da351d2284274c20a35e58c17297876f/users/a58a68bd913c46c2aee896d2f05f015d/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:14.599569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.610264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3c91-052b-4d0a-9f46-33d5399c7f0d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.666150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.666751 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.667037 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.667321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.667954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.670238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d2712-361a-4bd3-ab0b-7ce8ab175d94 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.679826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1299/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:14.684105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.694325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c529-92e9-441d-9edf-fe5b5b88a08d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.698877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.699556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.699833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.700104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] PATH_INFO: `/v3/projects/da351d2284274c20a35e58c17297876f/users/a58a68bd913c46c2aee896d2f05f015d/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.701973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da351d2284274c20a35e58c17297876f, user_id=a58a68bd913c46c2aee896d2f05f015d, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.704661 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.710594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:14.715634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1275/2574] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:14 2022] PUT /identity/v3/projects/da351d2284274c20a35e58c17297876f/users/a58a68bd913c46c2aee896d2f05f015d/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:14.726398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.726985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.726985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.754654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] MFA Rules not processed for user `a58a68bd913c46c2aee896d2f05f015d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:14.755868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:14.771692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:14.823408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1300/2575] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:14.833980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:14.835743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:14.892596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5a27-962c-44ab-8df5-e5861098bb10 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:14.896180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:14.896775 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:14.897049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:14.897317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:14.906529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:14.907973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0d9ce-8f46-47f4-9e7a-95e3d9f0897f service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:14.917413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1276/2576] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:15.281878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:15.342870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4c2e-42d3-46b6-91c0-1f2f28f0a0e7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:15.347291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:15.347908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:15.348184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:15.348452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] PATH_INFO: `/v3/users/591f1a564030413bacc71fd31eb9fb00` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:15.349539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591f1a564030413bacc71fd31eb9fb00)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:15.351482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:15.396090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591f1a564030413bacc71fd31eb9fb00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.404014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591f1a564030413bacc71fd31eb9fb00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.404615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591f1a564030413bacc71fd31eb9fb00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.405209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591f1a564030413bacc71fd31eb9fb00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.416844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591f1a564030413bacc71fd31eb9fb00'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.428932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1301/2577] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:15 2022] DELETE /identity/v3/users/591f1a564030413bacc71fd31eb9fb00 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:15.433514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:15.433800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:15.434073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:15.453607 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:15.454787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:15.510728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1277/2578] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:15.520948 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:15.522811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:15.557396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:15.583569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6e167-3b52-40b1-8512-c57a66bf0be6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:15.588789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:15.589669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:15.590089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:15.590499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:15.604046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:15.606250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:15.618748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1302/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:15.891487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:15.892998 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:15.904791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29a67-88d2-43b7-91e5-d655868785d6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:15.909449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:15.910083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:15.910357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:15.910627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] PATH_INFO: `/v3/projects/bff96e9b7ef14b46847c10ab2c7d3885` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:15.911795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff96e9b7ef14b46847c10ab2c7d3885)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:15.914181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:15.965166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff96e9b7ef14b46847c10ab2c7d3885', 'request_id': 'req-b8735267-6a1d-4d95-825e-b38a4221c41a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.972422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff96e9b7ef14b46847c10ab2c7d3885', 'request_id': 'req-b8735267-6a1d-4d95-825e-b38a4221c41a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.978185 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff96e9b7ef14b46847c10ab2c7d3885', 'request_id': 'req-b8735267-6a1d-4d95-825e-b38a4221c41a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.989536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] The token cache is being invalidate because project bff96e9b7ef14b46847c10ab2c7d3885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:15.989825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.990446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:15.991949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1278/2580] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:15 2022] DELETE /identity/v3/projects/bff96e9b7ef14b46847c10ab2c7d3885 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:15.995965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.006184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcfc4-61d1-4445-a3f9-72871c577f31 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.061877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.062503 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.062784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.063081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] PATH_INFO: `/v3/users/a58a68bd913c46c2aee896d2f05f015d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.064210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58a68bd913c46c2aee896d2f05f015d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.066159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.113244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58a68bd913c46c2aee896d2f05f015d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.123983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58a68bd913c46c2aee896d2f05f015d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.124597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58a68bd913c46c2aee896d2f05f015d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.125196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58a68bd913c46c2aee896d2f05f015d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.137056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f026d7d0-98c4-4530-a226-18184e25189c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58a68bd913c46c2aee896d2f05f015d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.149481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1303/2581] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:15 2022] DELETE /identity/v3/users/a58a68bd913c46c2aee896d2f05f015d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:16.421663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.423225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:16.436188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735267-6a1d-4d95-825e-b38a4221c41a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.467877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:16.501796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.502435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.502717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.502991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] PATH_INFO: `/v3/projects/da351d2284274c20a35e58c17297876f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.504136 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da351d2284274c20a35e58c17297876f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.506061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.551590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da351d2284274c20a35e58c17297876f', 'request_id': 'req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.558744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da351d2284274c20a35e58c17297876f', 'request_id': 'req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.564605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da351d2284274c20a35e58c17297876f', 'request_id': 'req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.575959 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] The token cache is being invalidate because project da351d2284274c20a35e58c17297876f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:16.576248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.576876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d8376830-ceae-4a14-8a2d-39c4ebf9f49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:16.578351 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1279/2582] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:16 2022] DELETE /identity/v3/projects/da351d2284274c20a35e58c17297876f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:16.583225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.583515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.583795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.604030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:16.605242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:16.653847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:16.666798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1304/2583] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:16.674532 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.674818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.675123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.694871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:16.696112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:16.704644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1280/2584] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:16.708745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.718902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93159f-97db-40ec-94f3-21d693c331f9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.723461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.724062 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.724341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.724619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.725258 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:16.725561 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.727166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.738761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1305/2585] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:16.742820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.751900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99a57-17c5-44b6-930d-1373a3777227 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.756526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.757115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.757396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.757671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.758310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.760245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.787888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1281/2586] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:16.791764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.801523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53867e1-e4e6-4ac6-bfdb-7a863f024492 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.856715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.857314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.857595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.857870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.858489 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.860467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.881217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1306/2587] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:16 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:16.885313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.896146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fdfd-8d59-4cce-b6bf-fcd124712ee2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.900928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.901531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.901816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.902091 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.902738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.904376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.914209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1282/2588] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:16.918159 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.929009 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafc793-20d7-4f4e-8d16-b4f04196c214 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.933763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.934365 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.935172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.935451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.936091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.937698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a7d9f-0c9a-42e9-b972-944eb857f088 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.948143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1307/2589] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:16.952958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:16.962686 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becf0a0-d368-4600-9e6b-2afeb8244c46 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:16.967349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:16.967988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:16.968270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:16.968545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] PATH_INFO: `/v3/projects/c2c03ecde76e40aea8f6e0773a35f28b/users/7f5bd7cf5dd44be4bf2c2c5892c5479e/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:16.982990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c03ecde76e40aea8f6e0773a35f28b, user_id=7f5bd7cf5dd44be4bf2c2c5892c5479e, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:16.985672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:16.999486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1283/2590] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:16 2022] PUT /identity/v3/projects/c2c03ecde76e40aea8f6e0773a35f28b/users/7f5bd7cf5dd44be4bf2c2c5892c5479e/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:17.010732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:17.011240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:17.011343 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:17.040177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] MFA Rules not processed for user `7f5bd7cf5dd44be4bf2c2c5892c5479e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:17.041395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:17.229010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1308/2591] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:17.240939 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:17.242665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:17.300639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd46e87-75be-463c-a058-b348a31695f6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:17.304230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:17.304836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:17.305116 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:17.305388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:17.312118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:17.314470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:17.316289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786f54b-76f5-44c7-a412-189ca15237b7 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:17.326533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1284/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:20.316508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:20.364681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:20.378114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ec7f8-5848-41f3-b642-5496f683fea5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:20.382501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:20.383144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:20.383424 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:20.383691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] PATH_INFO: `/v3/users/7f5bd7cf5dd44be4bf2c2c5892c5479e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:20.384799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5bd7cf5dd44be4bf2c2c5892c5479e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:20.386678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:20.432647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5bd7cf5dd44be4bf2c2c5892c5479e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:20.440571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5bd7cf5dd44be4bf2c2c5892c5479e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:20.441182 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5bd7cf5dd44be4bf2c2c5892c5479e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:20.441779 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5bd7cf5dd44be4bf2c2c5892c5479e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:20.453425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5bd7cf5dd44be4bf2c2c5892c5479e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:20.465161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1309/2593] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:20 2022] DELETE /identity/v3/users/7f5bd7cf5dd44be4bf2c2c5892c5479e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:20.469596 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:20.470087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:20.470205 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:20.608690 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:20.609831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:20.666249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1285/2594] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:20.676578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:20.678025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:20.733936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532886e-f3e1-4b90-b8a3-7c2105e1ef01 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:20.737423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:20.738013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:20.738294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:20.738563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:20.747173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:20.748581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca331e-ac9e-4cbd-9eb0-4ea42a3f4c55 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:20.757715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1310/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:21.026493 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.027918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:21.042375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90b56-dd1b-4760-bd5b-e3a5311507df None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.047445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.048292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.048578 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.048850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] PATH_INFO: `/v3/projects/c2c03ecde76e40aea8f6e0773a35f28b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.049987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c03ecde76e40aea8f6e0773a35f28b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.052068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.102013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c03ecde76e40aea8f6e0773a35f28b', 'request_id': 'req-e13c23d4-ee68-413c-b919-bfdecac20a49'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:21.111317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c03ecde76e40aea8f6e0773a35f28b', 'request_id': 'req-e13c23d4-ee68-413c-b919-bfdecac20a49'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:21.117182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c03ecde76e40aea8f6e0773a35f28b', 'request_id': 'req-e13c23d4-ee68-413c-b919-bfdecac20a49'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:21.128663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] The token cache is being invalidate because project c2c03ecde76e40aea8f6e0773a35f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:21.128951 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:21.129583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e13c23d4-ee68-413c-b919-bfdecac20a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:21.131061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1286/2596] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:21 2022] DELETE /identity/v3/projects/c2c03ecde76e40aea8f6e0773a35f28b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:21.135930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.136216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.136491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.156891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:21.158024 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:21.215322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1311/2597] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:22:21.223743 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.224022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.224293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.243524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:21.244709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:21.252379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1287/2598] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:21.256398 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.266334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2aed7-0369-4a52-ba25-93254de7756f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.270811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.271432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.271716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.271983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.272615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:21.272913 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.274473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.283626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:21.287107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1312/2599] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:21.291390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.302575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f8f0-541e-4340-ab46-0cc2c75a956e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.307299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.307898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.308178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.308449 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.309101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.311520 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.337963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1288/2600] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:21.342105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.351815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1169e3-110b-4276-a94c-cbf1b3ca4dc9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.406506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.407178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.407407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.407673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.408296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.410175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.430435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1313/2601] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:21.435061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.445340 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2a5f-c878-4ed0-a6ef-73664d8b3b2c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.450647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.451274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.451552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.451822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.452463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.454052 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.463741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1289/2602] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:21.467565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.477292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb170ce-f9d4-46d0-9e77-93e1ac484957 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.482251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.482830 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.483141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.483413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.484041 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.485630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402431ea-0c2e-4911-881a-839b4c0fe2e2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.495279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1314/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:21.499549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.509030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67bb4-4ebf-47cd-8dd0-ed6312861608 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.514037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.514671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.514948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.515260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] PATH_INFO: `/v3/projects/816ad6002bb0492b854d79b793003237/users/5ec494dc98294981be5b4adb50b08703/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.529108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=816ad6002bb0492b854d79b793003237, user_id=5ec494dc98294981be5b4adb50b08703, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.531751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.544127 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1290/2604] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:21 2022] PUT /identity/v3/projects/816ad6002bb0492b854d79b793003237/users/5ec494dc98294981be5b4adb50b08703/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:22:21.554349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.554631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.554904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.583165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] MFA Rules not processed for user `5ec494dc98294981be5b4adb50b08703`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:21.584360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:21.646730 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1315/2605] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:21.651114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.667988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:21.712258 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84f9-5e2c-4257-b671-3727492ca0af admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.716863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.717464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.717755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.718033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.718685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.720639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.747499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1291/2606] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:21.751494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.761858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755b13-df94-4ce6-a259-aba06fe1cf4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.816422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.817023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.817321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.817583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.818215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.820154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.835293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:21.842126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1316/2607] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:21.846063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.856774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015629-3954-4feb-9680-e5becc9379a9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.861252 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.861839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.862114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.862383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.863020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.864618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.874857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1292/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:21.880869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.890732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce4b2-46bd-45a3-86f1-896721c100ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.895386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.895983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.896264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.896542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.897195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.898768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b97c-3d26-4616-b7e4-f2f3480283f2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.908562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1317/2609] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:21.912492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:21.922663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b905c9-a89b-4b53-b998-bcc644df9215 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:21.927233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:21.927866 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.928139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.928409 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] PATH_INFO: `/v3/projects/2d26f266155947a49cbce29caeb3b59a/users/7f3af9ccd85b4c2a8faf52f543138689/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.943247 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d26f266155947a49cbce29caeb3b59a, user_id=7f3af9ccd85b4c2a8faf52f543138689, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:21.945857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:21.958256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1293/2610] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:21 2022] PUT /identity/v3/projects/2d26f266155947a49cbce29caeb3b59a/users/7f3af9ccd85b4c2a8faf52f543138689/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:21.969271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:21.969589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:21.969870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:21.999251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] MFA Rules not processed for user `7f3af9ccd85b4c2a8faf52f543138689`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:22.000452 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:22.062480 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1318/2611] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:22.066900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.129279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d141-9189-4282-8bf2-3494764785b7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.133855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.134456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.134735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.135010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.135672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.137592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.163825 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1294/2612] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:22 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:22.167889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.178817 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00559-8a32-47aa-b147-a2cb03b754b7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.236534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.237574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.237863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.238334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.238964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.240899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.261597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1319/2613] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:22 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:22.265673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.275876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee8438-d386-4094-b3d5-c83ba8a050bf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.280980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.281575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.281857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.282131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.282769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.284397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.294714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1295/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:22.298853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.308555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cf82-f888-43de-a856-3e1981980a23 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.313174 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.313819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.314096 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.314367 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] PATH_INFO: `/v3/projects/2a86d27422c64ea1aad5c923956f32fe/users/6819094206594b0891fc98e7f8282b0f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.328689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a86d27422c64ea1aad5c923956f32fe, user_id=6819094206594b0891fc98e7f8282b0f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.331309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.344098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1320/2615] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:22 2022] PUT /identity/v3/projects/2a86d27422c64ea1aad5c923956f32fe/users/6819094206594b0891fc98e7f8282b0f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:22.347991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.358734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25dfa-d5d6-4018-8f05-9d64d5b08016 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.395839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:22.415405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.416013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.416292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.416565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.417201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.419396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544c044-f021-497d-ad7e-48e7b39d3907 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.428680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1296/2616] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:22.432980 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.444316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcba-54e9-4cce-b36d-d8db34b8566e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.449203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.450350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.450630 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.450903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] PATH_INFO: `/v3/projects/2a86d27422c64ea1aad5c923956f32fe/users/6819094206594b0891fc98e7f8282b0f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.452822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a86d27422c64ea1aad5c923956f32fe, user_id=6819094206594b0891fc98e7f8282b0f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.455486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.466140 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1321/2617] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:22 2022] PUT /identity/v3/projects/2a86d27422c64ea1aad5c923956f32fe/users/6819094206594b0891fc98e7f8282b0f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:22:22.476474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.476761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.477036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.504206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] MFA Rules not processed for user `6819094206594b0891fc98e7f8282b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:22.505404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:22.572342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1297/2618] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:22.586916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:22.588676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:22.621171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:22.647868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abfd9b-8c45-4929-a0de-837407c7410f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:22.651415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:22.652005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:22.652278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:22.652543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:22.706376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:22.707736 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:22.717240 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1322/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:24.232175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:24.233580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:24.245235 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4423e-596a-4071-8219-beaefe6cf2a7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:24.248741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:24.249331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:24.249605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:24.249870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:24.303738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:24.305098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:24.314051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1298/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:22:24.826440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:24.834789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe2911-8402-41d2-a60a-795a4c34579b service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:24.838377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:24.838968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:24.839278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:24.839552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:24.848170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:24.849584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2470da-b5ba-41c5-8588-0dbb997fdb27 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:24.859506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1323/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:27.826458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:27.886462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb47b-ff9d-46f9-9253-3951e3dc1b25 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:27.890958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:27.891618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:27.891899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:27.892173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] PATH_INFO: `/v3/users/5ec494dc98294981be5b4adb50b08703` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:27.893281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec494dc98294981be5b4adb50b08703)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:27.895229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:27.896660 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:27.943284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec494dc98294981be5b4adb50b08703'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:27.950255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec494dc98294981be5b4adb50b08703'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:27.950847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec494dc98294981be5b4adb50b08703'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:27.951464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec494dc98294981be5b4adb50b08703'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:27.958250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec494dc98294981be5b4adb50b08703'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:27.975047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1299/2622] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:27 2022] DELETE /identity/v3/users/5ec494dc98294981be5b4adb50b08703 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:27.979789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:27.980252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:27.980374 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:27.999944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:28.001125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:28.058138 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1324/2623] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:28.068398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:28.069811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:28.126225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c49113-0d8b-4095-b8f2-56f4c9cf9130 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:28.129876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:28.130478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:28.130753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:28.131141 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:28.139910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:28.141345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:28.151487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1300/2624] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:28.411627 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:28.413123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:28.427335 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e71b-b3d2-4fdd-a120-deffcc44be8e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:28.432562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:28.434130 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:28.434419 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:28.434693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] PATH_INFO: `/v3/projects/816ad6002bb0492b854d79b793003237` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:28.435965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816ad6002bb0492b854d79b793003237)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:28.438729 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:28.486846 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816ad6002bb0492b854d79b793003237', 'request_id': 'req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.492276 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816ad6002bb0492b854d79b793003237', 'request_id': 'req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.499328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816ad6002bb0492b854d79b793003237', 'request_id': 'req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.500580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:28.513300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] The token cache is being invalidate because project 816ad6002bb0492b854d79b793003237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:28.513583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.514219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.515705 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1325/2625] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:28 2022] DELETE /identity/v3/projects/816ad6002bb0492b854d79b793003237 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:28.519796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:28.529882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a70e6-e813-4d7d-85df-12bf7e514479 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:28.584387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:28.585008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:28.585286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:28.585557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] PATH_INFO: `/v3/users/7f3af9ccd85b4c2a8faf52f543138689` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:28.586656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3af9ccd85b4c2a8faf52f543138689)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:28.588611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:28.610723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:28.634992 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3af9ccd85b4c2a8faf52f543138689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.642309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3af9ccd85b4c2a8faf52f543138689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.642918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3af9ccd85b4c2a8faf52f543138689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.643551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3af9ccd85b4c2a8faf52f543138689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.650328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3af9ccd85b4c2a8faf52f543138689'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:28.667796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1301/2626] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:28 2022] DELETE /identity/v3/users/7f3af9ccd85b4c2a8faf52f543138689 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:28.938678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:28.940285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:28.954504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2016-9b24-4f33-8aa2-cd8d6fc40aa6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:29.015615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:29.016235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.016462 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.016739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] PATH_INFO: `/v3/projects/2d26f266155947a49cbce29caeb3b59a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.017868 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d26f266155947a49cbce29caeb3b59a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:29.019816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:29.067440 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d26f266155947a49cbce29caeb3b59a', 'request_id': 'req-edbb065b-0eb0-4374-a574-234e9fc72282'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.073170 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d26f266155947a49cbce29caeb3b59a', 'request_id': 'req-edbb065b-0eb0-4374-a574-234e9fc72282'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.080640 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d26f266155947a49cbce29caeb3b59a', 'request_id': 'req-edbb065b-0eb0-4374-a574-234e9fc72282'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.092191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] The token cache is being invalidate because project 2d26f266155947a49cbce29caeb3b59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:29.092470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.093105 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.094811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1326/2627] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:28 2022] DELETE /identity/v3/projects/2d26f266155947a49cbce29caeb3b59a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:29.098634 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:29.100098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:29.114858 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe82d8-710a-4db8-a7d1-8bf953b70e22 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:29.176737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:29.177831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.178115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.178392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] PATH_INFO: `/v3/users/6819094206594b0891fc98e7f8282b0f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.179547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6819094206594b0891fc98e7f8282b0f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:29.182144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:29.248739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6819094206594b0891fc98e7f8282b0f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.256464 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6819094206594b0891fc98e7f8282b0f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.257223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6819094206594b0891fc98e7f8282b0f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.257950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6819094206594b0891fc98e7f8282b0f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.264862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-91744e29-ca0c-4108-8523-aac7ed689130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6819094206594b0891fc98e7f8282b0f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.281555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1302/2628] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:29 2022] DELETE /identity/v3/users/6819094206594b0891fc98e7f8282b0f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:29.546545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:29.548031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:29.561798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb065b-0eb0-4374-a574-234e9fc72282 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:29.620134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:29.620764 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.621039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.621804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] PATH_INFO: `/v3/projects/2a86d27422c64ea1aad5c923956f32fe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.622887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a86d27422c64ea1aad5c923956f32fe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:29.624802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:29.655043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:29.674029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a86d27422c64ea1aad5c923956f32fe', 'request_id': 'req-8f294fe1-57b8-4611-90e4-986be5a4ca90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.679885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a86d27422c64ea1aad5c923956f32fe', 'request_id': 'req-8f294fe1-57b8-4611-90e4-986be5a4ca90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.690647 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a86d27422c64ea1aad5c923956f32fe', 'request_id': 'req-8f294fe1-57b8-4611-90e4-986be5a4ca90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.702239 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] The token cache is being invalidate because project 2a86d27422c64ea1aad5c923956f32fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:29.702531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.703186 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8f294fe1-57b8-4611-90e4-986be5a4ca90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:29.704663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1327/2629] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:29 2022] DELETE /identity/v3/projects/2a86d27422c64ea1aad5c923956f32fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:29.709632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.709917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.710192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.729826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:29.731015 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:29.743804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:29.791610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1303/2630] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:29.854694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.855002 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.855299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.875129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:29.876312 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:29.883959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1328/2631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:29.888856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:29.898314 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ea3a-4d9f-4878-b74c-276d7fc4dfe5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:29.902899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:29.903531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.903809 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.904076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.904711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:29.905008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:29.906592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:29.917691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1304/2632] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:29.921801 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:29.932411 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf92c-0798-4b09-9b37-3be5f2a10896 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:29.937559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:29.938149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:29.938426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:29.938694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:29.939356 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:29.941282 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:29.968666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1329/2633] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:29 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:29.973041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:29.983558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a7f76-a1cb-474f-bd9d-78bafd5ce0b9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:30.037156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:30.037757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.038073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.038336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.038933 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:30.040868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:30.061819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1305/2634] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:29 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:30.066195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:30.076573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e696b-d273-4e65-8ddf-9332762899be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:30.081215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:30.081813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.082094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.082363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.083003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:30.084604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:30.095051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1330/2635] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:30.099017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:30.109547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d37c-9564-4e67-a8fe-13a5df091663 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:30.114142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:30.114764 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.115072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.115353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.115990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:30.117587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3f0d-2187-4077-a148-e04f9b8f5737 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:30.128723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1306/2636] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:30.133016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:30.142781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3420ca8-2e81-4815-82d6-65190a12357d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:30.147395 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:30.148033 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.148310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.148580 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] PATH_INFO: `/v3/projects/0dd49bf28e984ac28aa0564212705618/users/238710e0d873411f9f6c372cc031f5c0/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.162679 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd49bf28e984ac28aa0564212705618, user_id=238710e0d873411f9f6c372cc031f5c0, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:30.165341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:30.178172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1331/2637] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:30 2022] PUT /identity/v3/projects/0dd49bf28e984ac28aa0564212705618/users/238710e0d873411f9f6c372cc031f5c0/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:30.188781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.189066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.189339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.217259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] MFA Rules not processed for user `238710e0d873411f9f6c372cc031f5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:30.218495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:30.284841 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1307/2638] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:30.298614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:30.300581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:30.360605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91069c-c50c-4211-83e8-6b9a4a1436b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:30.364386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7bd82c6d3b4048a3a0256b8802a86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:30.364992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:30.365268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:30.365537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:30.378849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:30.380397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:30.389579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1332/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:40.281909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:40.385218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:44.464575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:44.465983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:44.522147 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1bbc9-aca0-4832-b50b-119c67fc3a4e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:44.525699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:44.526308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:44.526588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:44.526859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:44.528591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:44.597256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:44.598931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:44.617066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1308/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:47.824038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:47.826261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:47.841550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c70de-c570-40f5-bb40-db72c7fe3028 service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:47.848606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:47.849582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:47.850039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:47.850553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] PATH_INFO: `/v3/users/ab3052e5c0b64d758990d0b78f48a00f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:47.852095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3052e5c0b64d758990d0b78f48a00f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:47.854253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:47.901658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3052e5c0b64d758990d0b78f48a00f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:47.909114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3052e5c0b64d758990d0b78f48a00f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:47.909799 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3052e5c0b64d758990d0b78f48a00f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:47.910446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3052e5c0b64d758990d0b78f48a00f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:47.923693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-edf94e2e-fd6a-4044-8bb3-de5007fa00d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3052e5c0b64d758990d0b78f48a00f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:47.937324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1333/2641] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:47 2022] DELETE /identity/v3/users/ab3052e5c0b64d758990d0b78f48a00f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:48.159402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.170405 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5288d62-b23f-4e10-9ac1-bf6e42d63c42 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.252265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.252830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.253114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.253391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] PATH_INFO: `/v3/projects/1a257f8701524c21b6d155cc56dafd5a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.254516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a257f8701524c21b6d155cc56dafd5a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.256469 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.307737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a257f8701524c21b6d155cc56dafd5a', 'request_id': 'req-71a16832-3ee5-42d4-aa33-9f0207791c33'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:48.311180 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:48.317257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a257f8701524c21b6d155cc56dafd5a', 'request_id': 'req-71a16832-3ee5-42d4-aa33-9f0207791c33'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:48.324713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a257f8701524c21b6d155cc56dafd5a', 'request_id': 'req-71a16832-3ee5-42d4-aa33-9f0207791c33'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:48.336720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] The token cache is being invalidate because project 1a257f8701524c21b6d155cc56dafd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:48.337011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:48.337644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-71a16832-3ee5-42d4-aa33-9f0207791c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:48.339333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1309/2642] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:48 2022] DELETE /identity/v3/projects/1a257f8701524c21b6d155cc56dafd5a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:48.344423 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.344708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.345005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.365162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:48.366345 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:48.428043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1334/2643] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:48.436407 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.436691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.436964 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.457175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:48.458371 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:48.466159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1310/2644] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:48.470910 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.480824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b096-e3ba-4e25-a087-126db230c814 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.485370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.485966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.486244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.486513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.487226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:48.487529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.489107 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.500902 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1335/2645] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:48.505222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.514870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4059450-3605-4831-b518-fc6ff25b34e4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.519476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.520059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.520334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.520605 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.521231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.523125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.549242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1311/2646] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:48 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:48.553483 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.563890 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221f39-d7ab-4abf-815f-32099602b74e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.618372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.618967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.619277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.619552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.620183 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.622069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.630355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:48.645944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1336/2647] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:48 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:48.650410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.660487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c65deb-dff4-47e8-abb1-2c74cd24e882 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.664971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.665562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.665837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.666107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.666745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.668379 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.678400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1312/2648] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:48.682030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.691875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5251d8-cc06-4353-ab82-3e7f64bba488 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.696412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.696998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.697275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.697575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.698203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.699808 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570acd6-0c20-410c-a211-ae12d196d59f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.711173 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1337/2649] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:48.715486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.726242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299729-3878-404f-a004-75d7192b3985 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.731211 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.731867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.732145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.732419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] PATH_INFO: `/v3/projects/72672e11b0c944e8bec49d2a4e5dbe9b/users/3264d2f0d3054fb897a1585762085697/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.747123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72672e11b0c944e8bec49d2a4e5dbe9b, user_id=3264d2f0d3054fb897a1585762085697, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:48.750230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:48.764240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1313/2650] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:48 2022] PUT /identity/v3/projects/72672e11b0c944e8bec49d2a4e5dbe9b/users/3264d2f0d3054fb897a1585762085697/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:48.775266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.775570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.775841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:48.803987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] MFA Rules not processed for user `3264d2f0d3054fb897a1585762085697`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:48.805179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:48.871227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1338/2651] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:48.882522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:48.884284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:48.988713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1283c6-7bff-4dea-91af-32a46ee12fcd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:48.994920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:48.995564 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:48.995915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:48.996113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:49.004108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:49.005687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b0a5a-2a06-4f38-a509-d1ca1f8dccd4 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:49.014821 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1314/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:51.699350 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:51.762629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a284031-5668-4ad7-ae96-a0687ff51d4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:51.769459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:51.770089 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:51.770364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:51.770631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] PATH_INFO: `/v3/users/3264d2f0d3054fb897a1585762085697` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:51.771771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3264d2f0d3054fb897a1585762085697)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:51.773661 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:51.818382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3264d2f0d3054fb897a1585762085697'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:51.826046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3264d2f0d3054fb897a1585762085697'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:51.826672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3264d2f0d3054fb897a1585762085697'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:51.827336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3264d2f0d3054fb897a1585762085697'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:51.838128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:51.839341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3264d2f0d3054fb897a1585762085697'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:51.853521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1339/2653] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:51 2022] DELETE /identity/v3/users/3264d2f0d3054fb897a1585762085697 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:51.858474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:51.858962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:51.859093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:51.877323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:51.878496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:51.907541 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:51.937748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1315/2654] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:51.947537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:51.948918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:52.006166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b433f48-dc35-43a0-9357-3b317995bc4c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.009833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.010434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.010715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.010989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.020386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.026163 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88179f44-24a8-4e97-a766-0f281013aa02 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.032349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1340/2655] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:52.304882 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.306328 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:52.320927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ed9de-42bf-49e1-9f72-c3196d5925ed None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.333375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.334035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.334373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.334653 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] PATH_INFO: `/v3/projects/72672e11b0c944e8bec49d2a4e5dbe9b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.335850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72672e11b0c944e8bec49d2a4e5dbe9b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.337766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.383327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72672e11b0c944e8bec49d2a4e5dbe9b', 'request_id': 'req-28f72cad-b42f-4ab5-be43-83fa3772a890'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:52.391560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72672e11b0c944e8bec49d2a4e5dbe9b', 'request_id': 'req-28f72cad-b42f-4ab5-be43-83fa3772a890'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:52.397375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72672e11b0c944e8bec49d2a4e5dbe9b', 'request_id': 'req-28f72cad-b42f-4ab5-be43-83fa3772a890'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:52.413406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] The token cache is being invalidate because project 72672e11b0c944e8bec49d2a4e5dbe9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:52.413685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:52.414343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-28f72cad-b42f-4ab5-be43-83fa3772a890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:52.415878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1316/2656] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:52 2022] DELETE /identity/v3/projects/72672e11b0c944e8bec49d2a4e5dbe9b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:52.421158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.421446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.421718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.441298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:52.442493 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:52.502926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1341/2657] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:52.510575 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.510925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.511245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.530517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:52.531734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:52.539376 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1317/2658] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:52.543359 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.553253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94a689-48f4-4d11-a32f-8adf9f9a8435 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.557684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.558268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.558547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.558814 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.559539 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:52.560490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.562154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.573305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1342/2659] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:52.577482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.586486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ae0c4-d897-4aeb-bf1a-693eb556ea98 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.591092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.591680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.591957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.592225 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.592840 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.594727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.621331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1318/2660] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:52 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:52.626291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.636197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626df18-4c5f-4b0c-84f7-11f2999ecb41 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.694391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.695001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.695308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.695956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.696195 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.698093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.719967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1343/2661] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:52 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:52.724477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.735715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08101e6-dfa3-4573-9524-84cf5e421231 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.740458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.741268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.741615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.741958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.742631 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.744246 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.755169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1319/2662] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:52.759825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.769545 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dbac9-424e-4911-a686-3da1db1d7b61 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.774369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.774973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.775386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.775690 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.776338 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.777984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb0380-bb5a-4be5-89c7-9197ee48aa7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.779989 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:52.791162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1344/2663] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:52.796004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.806135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0e209-4202-44ad-a488-b57d63aa09d6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:52.810673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:52.811427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.811711 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.811980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] PATH_INFO: `/v3/projects/13a4ce090b314a1abd4e490d56a63b51/users/38e8421fecc443bfa80119924eda54f7/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.827239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a4ce090b314a1abd4e490d56a63b51, user_id=38e8421fecc443bfa80119924eda54f7, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:52.830794 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:52.845616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1320/2664] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:52 2022] PUT /identity/v3/projects/13a4ce090b314a1abd4e490d56a63b51/users/38e8421fecc443bfa80119924eda54f7/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:22:52.857277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:52.857564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:52.857839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:52.886825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] MFA Rules not processed for user `38e8421fecc443bfa80119924eda54f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:52.888573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:52.974257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1345/2665] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:52.985704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:52.987482 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:53.044671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:53.065325 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ab416-a452-4e55-bcc9-ef6d62e01404 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:53.070831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:53.071573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.071855 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.072126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:53.080554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:53.082142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8fab6-b370-496b-878d-291e26ac6f29 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:53.090645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1321/2666] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:53.293302 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:53.353075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848d85-7611-4b77-ad05-8469802dd153 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:53.358030 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:53.358653 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.358930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.359231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] PATH_INFO: `/v3/users/38e8421fecc443bfa80119924eda54f7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:53.360333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e8421fecc443bfa80119924eda54f7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:53.362222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:53.406693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e8421fecc443bfa80119924eda54f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.413498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e8421fecc443bfa80119924eda54f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.414268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e8421fecc443bfa80119924eda54f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.414886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e8421fecc443bfa80119924eda54f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.427373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e8421fecc443bfa80119924eda54f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.441628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1346/2667] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:53 2022] DELETE /identity/v3/users/38e8421fecc443bfa80119924eda54f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:53.446761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.447081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.447374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:53.466178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:53.467396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:53.524810 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1322/2668] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:53.534755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:53.536180 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:53.542633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:53.599109 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada11e5-e2a7-4836-88b9-342d499f4775 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:53.603144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:53.603901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.604285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.604570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:53.614621 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:53.616080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316aa28-c7c1-4e9c-b132-df59133388c4 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:53.625998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1347/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:53.886154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:53.887695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:53.902324 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3fc5-9947-4f7a-af26-adc1e927df6d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:53.907007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:53.907663 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.907936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.908203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] PATH_INFO: `/v3/projects/13a4ce090b314a1abd4e490d56a63b51` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:53.910362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a4ce090b314a1abd4e490d56a63b51)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:53.912303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:53.959787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a4ce090b314a1abd4e490d56a63b51', 'request_id': 'req-9a25d3c2-bd8c-4327-aded-05901af03cae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.967617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a4ce090b314a1abd4e490d56a63b51', 'request_id': 'req-9a25d3c2-bd8c-4327-aded-05901af03cae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.973175 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a4ce090b314a1abd4e490d56a63b51', 'request_id': 'req-9a25d3c2-bd8c-4327-aded-05901af03cae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.984899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] The token cache is being invalidate because project 13a4ce090b314a1abd4e490d56a63b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:53.985189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.985816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9a25d3c2-bd8c-4327-aded-05901af03cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:53.987307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1323/2670] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:53 2022] DELETE /identity/v3/projects/13a4ce090b314a1abd4e490d56a63b51 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:53.992087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:53.992520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:53.992636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.012226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:54.013407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:54.075695 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1348/2671] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:54.084693 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.085217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.085496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.105860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:54.107664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:54.119229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1324/2672] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:54.124149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.134537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8746-5e35-4dee-ae37-c60262195b5a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.139445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.139988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.140522 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.140800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.141425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:54.141721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.143329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.159537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1349/2673] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:22:54.160617 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.170165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece07abd-e289-4551-bc07-414a80b344c5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.175747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.176346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.176625 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.176894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.177522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.179452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.213167 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1325/2674] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:54.214381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.224997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92107197-6662-4f38-8cb7-20102942ee07 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.284766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.285427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.285700 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.285969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.286633 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.288557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.310333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1350/2675] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:54.314408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.324772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774467-4fa9-45b3-bd06-6d74e48ceb35 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.329481 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.330081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.330360 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.330630 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.331300 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.332946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.346474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1326/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:54.348036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.359150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568739e3-5132-41e5-83fc-aca27b775ce7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.363798 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.364383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.364715 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.364994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.365687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.367285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2d537-0d91-47ad-8f62-3d035b876ae2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.378615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1351/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:54.382565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.393203 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a5326-6b12-4bfe-940f-8fca66dd0052 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.397853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.398499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.398781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.399077 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] PATH_INFO: `/v3/projects/bb77ac3d14b14a2d9bb0365ec58cd237/users/4fe0866386b4434bb3811bf0dedac138/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.413719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb77ac3d14b14a2d9bb0365ec58cd237, user_id=4fe0866386b4434bb3811bf0dedac138, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.416445 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.424910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:54.430034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1327/2678] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:54 2022] PUT /identity/v3/projects/bb77ac3d14b14a2d9bb0365ec58cd237/users/4fe0866386b4434bb3811bf0dedac138/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:54.440991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.441272 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.441543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.466611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:54.469793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] MFA Rules not processed for user `4fe0866386b4434bb3811bf0dedac138`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:54.471322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:54.538077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1352/2679] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:54.542645 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.603375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f270903-8330-48c7-82b6-4958f01a83ed admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.607999 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.608599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.608878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.609149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.609776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.611724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.637544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1328/2680] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:54.642169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.652870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c875d6-efec-4add-9957-7dacc50c063b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.708049 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.708645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.708923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.709199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.709826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.711741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.738369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1353/2681] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:22:54.742334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.753131 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7dc25-d95e-4ae6-a8df-ddaa50a0d81e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.757872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.758467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.758747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.759017 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.759683 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.761299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.771650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1329/2682] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:54.775606 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.785216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88cba-3620-4aea-8152-e90d84b10621 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.789792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.790425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.790698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.790969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] PATH_INFO: `/v3/projects/b8b637c08602429aad3e1c6a232a52b9/users/83d726ea04f54f92be5812551c323728/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.805595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b637c08602429aad3e1c6a232a52b9, user_id=83d726ea04f54f92be5812551c323728, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.808226 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.821216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1354/2683] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:54 2022] PUT /identity/v3/projects/b8b637c08602429aad3e1c6a232a52b9/users/83d726ea04f54f92be5812551c323728/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:54.825114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.834871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25127d-b064-4cb5-abeb-57d0214e24b9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.890641 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.891279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.891557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.891830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.892483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.894082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff95937-44a1-4310-9344-5b73092461bd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.903437 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1330/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:54.907628 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:54.917490 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada6ea8-ddc3-4835-bc14-cf6bdc0714b6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:54.923407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:54.924157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.924441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.924713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] PATH_INFO: `/v3/projects/b8b637c08602429aad3e1c6a232a52b9/users/83d726ea04f54f92be5812551c323728/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.926610 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b637c08602429aad3e1c6a232a52b9, user_id=83d726ea04f54f92be5812551c323728, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:54.929516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:54.940659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1355/2685] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:54 2022] PUT /identity/v3/projects/b8b637c08602429aad3e1c6a232a52b9/users/83d726ea04f54f92be5812551c323728/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:54.950783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:54.951076 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:54.951359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:54.978346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] MFA Rules not processed for user `83d726ea04f54f92be5812551c323728`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:54.979583 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:55.042323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:55.052391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1331/2686] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:55.063922 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:55.065677 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:55.122894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc78f9-f230-49c8-a8d0-acc0a6e29cbe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:55.126508 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:55.127166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:55.127445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:55.127717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:55.136577 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:55.138015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:55.141865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:55.149064 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1356/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:55.222704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:55.233098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aa23b-0094-44a3-8e35-97a206631176 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:55.236708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:55.237311 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:55.237588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:55.237860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:55.294579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:55.295982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075325-0b63-4d75-9f07-0320f016e7ed service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:55.304914 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1332/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:58.667745 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:58.669122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:58.732781 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89013-1447-4ee9-adda-0d34850695b6 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:58.737255 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:58.737875 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:58.738158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:58.738427 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] PATH_INFO: `/v3/users/238710e0d873411f9f6c372cc031f5c0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:58.739558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] RBAC: Authorizing `identity:delete_user(user_id=238710e0d873411f9f6c372cc031f5c0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:58.741445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:58.786766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238710e0d873411f9f6c372cc031f5c0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:58.792986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238710e0d873411f9f6c372cc031f5c0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:58.793658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238710e0d873411f9f6c372cc031f5c0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:58.794305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238710e0d873411f9f6c372cc031f5c0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:58.806125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238710e0d873411f9f6c372cc031f5c0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:58.818191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1357/2689] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:22:58 2022] DELETE /identity/v3/users/238710e0d873411f9f6c372cc031f5c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:58.822679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:58.823182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:58.823279 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:58.842419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:58.843635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:58.901488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1333/2690] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:58.911381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:58.912757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:58.970086 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07d20-0415-44a9-8bc1-b4c61d2b665c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:58.973682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:58.974280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:58.974555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:58.974824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:58.984369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:58.985780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14608f-988f-4ffa-958a-1d1bf9722b72 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:58.996662 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1358/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:22:59.262972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.264397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:59.276681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2383-e35d-4147-a65d-e6e2b6b7c807 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.281289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.281988 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.282329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.282604 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] PATH_INFO: `/v3/projects/0dd49bf28e984ac28aa0564212705618` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.283804 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd49bf28e984ac28aa0564212705618)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.285737 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.331864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd49bf28e984ac28aa0564212705618', 'request_id': 'req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:59.338814 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd49bf28e984ac28aa0564212705618', 'request_id': 'req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:59.344436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd49bf28e984ac28aa0564212705618', 'request_id': 'req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:59.355406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] The token cache is being invalidate because project 0dd49bf28e984ac28aa0564212705618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:22:59.355691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:59.356786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-67bdb7c4-5867-4ca9-9d0a-cbc8c4bfc57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:22:59.358273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1334/2692] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:22:59 2022] DELETE /identity/v3/projects/0dd49bf28e984ac28aa0564212705618 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:59.363271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.363560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.363857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.383499 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:59.384686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:59.397295 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:59.449641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1359/2693] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:59.458898 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.459210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.459485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.479580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:59.480770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:59.489293 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1335/2694] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:59.493341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.503448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b48bf-5dfa-4f35-a919-a7ce2e7a9df6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.508023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.508624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.508897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.509166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.509811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:22:59.510111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.511752 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.529384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1360/2695] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:22:59.529515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.537172 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44047dd0-23dd-40a9-83bb-c64d020689f6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.542216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.542812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.543124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.543397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.544562 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.546456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.556582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:59.582762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1336/2696] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:22:59 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:59.586811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.597208 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c194ca-4267-43e3-b120-07d3734d07d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.654124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.654740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.655020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.655317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.655955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.657863 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.680145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1361/2697] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:22:59 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:22:59.684341 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.707295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8308-676d-4842-b1c5-92355183804d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.707295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.707295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.707295 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.707702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.707702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.707702 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.716629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1337/2698] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:22:59.718106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.728453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a358e-19f4-4085-b431-93e4194027e4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.733744 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.734344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.734648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.734925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.735607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.737175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a478e-5ff8-4ab7-8e3b-2307ce9490b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.747854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1362/2699] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:22:59.752119 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.762023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ef97c-2200-4ea4-8777-84d9ec765b3c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.766735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.767611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.767974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.768250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] PATH_INFO: `/v3/projects/191120090a1e414d9dc98aac2b0e326e/users/4a1eb04fff37408fa55cbfdd2765bc72/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.784691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191120090a1e414d9dc98aac2b0e326e, user_id=4a1eb04fff37408fa55cbfdd2765bc72, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:22:59.788234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:22:59.804624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1338/2700] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:22:59 2022] PUT /identity/v3/projects/191120090a1e414d9dc98aac2b0e326e/users/4a1eb04fff37408fa55cbfdd2765bc72/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:22:59.815014 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.815329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:22:59.815609 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:22:59.846294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] MFA Rules not processed for user `4a1eb04fff37408fa55cbfdd2765bc72`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:22:59.847596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:59.918125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1363/2701] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:22:59.929010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:22:59.931594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:22:59.993760 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e72414-6f30-47fe-a856-e2b7a2b96874 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:22:59.998833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:22:59.999561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:22:59.999844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:00.000132 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:00.009329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:00.010817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc2e1d-80e8-44e3-8fbd-7d95e6805f41 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:00.020436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1339/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:02.330328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:02.331749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:02.349296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:02.397498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d07ef-1204-4b09-bddb-d9b1e285dbef None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:02.401895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:02.402548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:02.402825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:02.403150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] PATH_INFO: `/v3/users/4fe0866386b4434bb3811bf0dedac138` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:02.404271 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe0866386b4434bb3811bf0dedac138)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:02.406164 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:02.450678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe0866386b4434bb3811bf0dedac138'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:02.457925 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe0866386b4434bb3811bf0dedac138'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:02.458553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe0866386b4434bb3811bf0dedac138'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:02.459162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe0866386b4434bb3811bf0dedac138'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:02.471790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe0866386b4434bb3811bf0dedac138'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:02.484449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1364/2703] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:23:02 2022] DELETE /identity/v3/users/4fe0866386b4434bb3811bf0dedac138 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:02.489021 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:02.489484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:02.489484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:02.510561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:02.511850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:02.568846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1340/2704] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:02.578651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:02.580084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:02.635597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bbfa-3fab-4b3d-a44c-71ac7ca96467 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:02.639251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:02.639849 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:02.640127 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:02.640399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:02.649044 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:02.650457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:02.660155 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1365/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:02.922796 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:02.924265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:02.939811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b795bd4-7d1b-4fbe-a373-eb3ceb580fdd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:02.945540 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:02.946149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:02.946435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:02.946697 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] PATH_INFO: `/v3/projects/bb77ac3d14b14a2d9bb0365ec58cd237` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:02.947890 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb77ac3d14b14a2d9bb0365ec58cd237)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:02.950366 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.002976 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb77ac3d14b14a2d9bb0365ec58cd237', 'request_id': 'req-a3876317-e86b-4f69-aafa-eed717550c46'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.005525 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:03.010932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb77ac3d14b14a2d9bb0365ec58cd237', 'request_id': 'req-a3876317-e86b-4f69-aafa-eed717550c46'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.018270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb77ac3d14b14a2d9bb0365ec58cd237', 'request_id': 'req-a3876317-e86b-4f69-aafa-eed717550c46'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.030717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] The token cache is being invalidate because project bb77ac3d14b14a2d9bb0365ec58cd237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:23:03.031022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.031703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.033419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1341/2706] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:23:02 2022] DELETE /identity/v3/projects/bb77ac3d14b14a2d9bb0365ec58cd237 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:03.037169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.046691 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cd73-5929-4f9f-a541-d1f13d5740e7 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.089333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:03.121392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.122478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.122908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.123370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] PATH_INFO: `/v3/users/83d726ea04f54f92be5812551c323728` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.126077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d726ea04f54f92be5812551c323728)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.128227 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.178370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d726ea04f54f92be5812551c323728'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.185404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d726ea04f54f92be5812551c323728'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.186039 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d726ea04f54f92be5812551c323728'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.186641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d726ea04f54f92be5812551c323728'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.198317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba53538d-ac98-4e7d-bcae-903e3cbecdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d726ea04f54f92be5812551c323728'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.210676 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1366/2707] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:23:03 2022] DELETE /identity/v3/users/83d726ea04f54f92be5812551c323728 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:03.494732 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.496446 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:03.514318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876317-e86b-4f69-aafa-eed717550c46 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.573303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.573934 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.574239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.574514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] PATH_INFO: `/v3/projects/b8b637c08602429aad3e1c6a232a52b9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.576297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b637c08602429aad3e1c6a232a52b9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.578194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.622623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b637c08602429aad3e1c6a232a52b9', 'request_id': 'req-feae7df5-539c-4889-bd83-e9ef7c9bef61'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.629055 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b637c08602429aad3e1c6a232a52b9', 'request_id': 'req-feae7df5-539c-4889-bd83-e9ef7c9bef61'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.634568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b637c08602429aad3e1c6a232a52b9', 'request_id': 'req-feae7df5-539c-4889-bd83-e9ef7c9bef61'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.645957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] The token cache is being invalidate because project b8b637c08602429aad3e1c6a232a52b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:23:03.646248 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.646878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-feae7df5-539c-4889-bd83-e9ef7c9bef61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:03.648345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1342/2708] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:23:03 2022] DELETE /identity/v3/projects/b8b637c08602429aad3e1c6a232a52b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:03.653247 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.653726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.653836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.673425 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:03.674615 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:03.732242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1367/2709] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:03.739994 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.740276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.740551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.763915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:03.765623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:03.776962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1343/2710] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:03.781511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.791530 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4d59-9db0-43a4-915c-1f71d9019f32 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.796746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.797364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.797646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.797920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.798573 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:23:03.799050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.801586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.815822 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1368/2711] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:23:03.820336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.829524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f75520-ce28-47e1-8d5b-abf00472b003 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.834463 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.835084 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.835365 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.835635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.836278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.838178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.864768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1344/2712] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:23:03 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:23:03.869203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.879933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54c5-98dc-4566-8c47-eb7c081e8889 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.920684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:03.937560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.938166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.938454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.938726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.939409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.941306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.964193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1369/2713] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:23:03 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:23:03.968522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:03.978827 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3779a-6ed1-4ac1-823e-7500f0e5a347 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:03.983856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:03.984450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:03.984727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:03.984997 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:03.985628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:03.987245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:03.997416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1345/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:23:04.001218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:04.011267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6732-c35f-4ec6-b0da-e5bd6c9e3bdf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:04.015988 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:04.016581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:04.016864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:04.017139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:04.017777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:04.019399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db065de-a170-4a85-b349-ac13e293a537 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:04.030389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1370/2715] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:23:04.034342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:04.044591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f479-6ae7-4cc7-a19f-d750fbadcb8c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:04.049110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:04.049747 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:04.050022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:04.050292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] PATH_INFO: `/v3/projects/8d6f5d1fb545440aa3592da882002d8e/users/48c6facb2350495c9a0f65e3672c407a/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:04.064776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6f5d1fb545440aa3592da882002d8e, user_id=48c6facb2350495c9a0f65e3672c407a, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:04.067453 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:04.079950 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1346/2716] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:23:04 2022] PUT /identity/v3/projects/8d6f5d1fb545440aa3592da882002d8e/users/48c6facb2350495c9a0f65e3672c407a/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:04.091823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:04.092123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:04.092389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:04.123596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] MFA Rules not processed for user `48c6facb2350495c9a0f65e3672c407a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:04.124829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:04.197872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1371/2717] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:04.208467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:04.210184 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:04.220853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:04.270210 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215a2b-51cd-4b1a-a272-0954726f1209 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:04.273808 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:04.274778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:04.275092 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:04.275367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:04.284095 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:04.285798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf7ee8-fb97-40b3-b03f-9218e9e39705 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:04.295013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1347/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:09.895919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:09.897307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:09.961835 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671f6a2-4820-43c6-911f-ede1e9886f6b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:09.966363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:09.966990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:09.967300 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:09.967572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] PATH_INFO: `/v3/users/4a1eb04fff37408fa55cbfdd2765bc72` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:09.968666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1eb04fff37408fa55cbfdd2765bc72)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:09.970558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:10.015551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1eb04fff37408fa55cbfdd2765bc72'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.022611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1eb04fff37408fa55cbfdd2765bc72'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.023243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1eb04fff37408fa55cbfdd2765bc72'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.023852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1eb04fff37408fa55cbfdd2765bc72'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.024973 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:10.038513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1eb04fff37408fa55cbfdd2765bc72'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.051482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1372/2719] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:23:09 2022] DELETE /identity/v3/users/4a1eb04fff37408fa55cbfdd2765bc72 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:10.055918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:10.056461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:10.056461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:10.079310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:10.080518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:10.139671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1348/2720] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:10.149156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:10.150608 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:10.206857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1fd2-9a01-460b-a08d-3841dee7a2f3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:10.210434 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:10.211023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:10.211326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:10.211595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:10.220994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:10.222429 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:10.232481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1373/2721] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:10.501406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:10.503834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:10.520678 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189290b-a5bd-49f5-a2d0-463e680f7492 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:10.526597 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:10.527275 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:10.527603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:10.528507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] PATH_INFO: `/v3/projects/191120090a1e414d9dc98aac2b0e326e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:10.530565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=191120090a1e414d9dc98aac2b0e326e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:10.533912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:10.584740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191120090a1e414d9dc98aac2b0e326e', 'request_id': 'req-588a3b97-cca1-4ea6-b570-9a8744b33b5b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.593098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191120090a1e414d9dc98aac2b0e326e', 'request_id': 'req-588a3b97-cca1-4ea6-b570-9a8744b33b5b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.612386 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191120090a1e414d9dc98aac2b0e326e', 'request_id': 'req-588a3b97-cca1-4ea6-b570-9a8744b33b5b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.626301 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] The token cache is being invalidate because project 191120090a1e414d9dc98aac2b0e326e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:23:10.626603 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.627292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-588a3b97-cca1-4ea6-b570-9a8744b33b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:10.628977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1349/2722] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:23:10 2022] DELETE /identity/v3/projects/191120090a1e414d9dc98aac2b0e326e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:16.794905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:16.796447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:16.809012 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5287-f62f-4849-8610-207bd8b4553c service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:16.864278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:16.864905 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:16.865189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:16.865463 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] PATH_INFO: `/v3/users/48c6facb2350495c9a0f65e3672c407a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:16.866590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c6facb2350495c9a0f65e3672c407a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:16.868532 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:16.913252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c6facb2350495c9a0f65e3672c407a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:16.922090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c6facb2350495c9a0f65e3672c407a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:16.922711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c6facb2350495c9a0f65e3672c407a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:16.923347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c6facb2350495c9a0f65e3672c407a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:16.936118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c6facb2350495c9a0f65e3672c407a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:16.940472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:16.950668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1374/2723] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:23:16 2022] DELETE /identity/v3/users/48c6facb2350495c9a0f65e3672c407a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:16.955073 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:16.955524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:16.955624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:16.974514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:16.975735 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:17.005368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:17.038007 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1350/2724] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:17.048206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.049582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:17.115687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af530d5f-e241-4ff4-933c-e527f17935bc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.119347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.119947 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.120220 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.120516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.129607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.131043 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a57ef7-0222-48ef-890c-a2e2dbe9f373 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.140789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1375/2725] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:17.406447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.407969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:17.420784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6217a-46d3-4065-b794-dda20491fab0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.426124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.426682 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.426966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.427315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] PATH_INFO: `/v3/projects/8d6f5d1fb545440aa3592da882002d8e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.428529 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6f5d1fb545440aa3592da882002d8e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.430491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.482413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6f5d1fb545440aa3592da882002d8e', 'request_id': 'req-014d6f1d-066c-47ac-9cb3-d1328039e8b9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:17.489152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6f5d1fb545440aa3592da882002d8e', 'request_id': 'req-014d6f1d-066c-47ac-9cb3-d1328039e8b9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:17.494707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6f5d1fb545440aa3592da882002d8e', 'request_id': 'req-014d6f1d-066c-47ac-9cb3-d1328039e8b9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:17.506049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] The token cache is being invalidate because project 8d6f5d1fb545440aa3592da882002d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:23:17.506336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:17.506972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-014d6f1d-066c-47ac-9cb3-d1328039e8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:23:17.508452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1351/2726] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:23:17 2022] DELETE /identity/v3/projects/8d6f5d1fb545440aa3592da882002d8e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:23:17.513964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.514248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.514518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.533267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:17.534444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:17.590860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1376/2727] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:17.599650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.599940 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.600214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.619408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:17.620595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:17.628741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1352/2728] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:17.632657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.642685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8b3d-5896-4552-917f-114655b310b5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.647254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.647842 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.648115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.648381 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.649021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:23:17.649349 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.650920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.663298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1377/2729] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:23:17.667592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.677974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234d5b-e342-448a-9dec-f2333f3bd444 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.689739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.690369 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.690635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.690908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.691591 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.693504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.721002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1353/2730] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:23:17 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:23:17.725893 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.736073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf03ad-1967-4778-8d2e-6dec997dcfec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.792394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.792954 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.793241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.793515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.794145 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.796085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.817172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1378/2731] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:23:17 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:23:17.821270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.831928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0fc83-b329-4c53-a40d-3d0b47fc32bd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.836434 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.837029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.837400 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.837676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.838305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.839924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.849457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1354/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:23:17.853548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.863244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170f2-1651-4911-9e94-041286404f14 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.867851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.868436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.868720 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.868985 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.869614 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.871819 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd367eb-d0f5-4c4c-980e-eed2a0676a1a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.882178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1379/2733] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:23:17.886057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:17.896586 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a3eed-9ab2-423f-aa6a-f6964f0ead3e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:17.901991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:17.902635 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.902915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.903219 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] PATH_INFO: `/v3/projects/d2d9d4e8bb604846b5869dfdd4788fe3/users/d70c7ea1cb47406585c970d15a3a155b/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.917665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d9d4e8bb604846b5869dfdd4788fe3, user_id=d70c7ea1cb47406585c970d15a3a155b, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:17.920889 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:17.934545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1355/2734] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:23:17 2022] PUT /identity/v3/projects/d2d9d4e8bb604846b5869dfdd4788fe3/users/d70c7ea1cb47406585c970d15a3a155b/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:23:17.939642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612b66-b2e7-4dfb-bd22-836d6b08900e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:17.939926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612b66-b2e7-4dfb-bd22-836d6b08900e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:17.940198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612b66-b2e7-4dfb-bd22-836d6b08900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:17.947191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:17.960315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75612b66-b2e7-4dfb-bd22-836d6b08900e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:17.961509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75612b66-b2e7-4dfb-bd22-836d6b08900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:18.019362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1380/2735] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:18.028787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:18.030571 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:18.085925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74133601-dd00-48a6-bdde-ba9d3a4082ed admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:18.089537 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:18.090135 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:18.090410 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:18.090679 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:18.097389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:18.099755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:18.101530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:18.114062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1356/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:18.709455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ff820-2efe-495f-8a9c-1c0076bd39b3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:18.709749 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ff820-2efe-495f-8a9c-1c0076bd39b3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:18.710025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ff820-2efe-495f-8a9c-1c0076bd39b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:18.738878 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-252ff820-2efe-495f-8a9c-1c0076bd39b3 None None] MFA Rules not processed for user `d70c7ea1cb47406585c970d15a3a155b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:18.740152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-252ff820-2efe-495f-8a9c-1c0076bd39b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:18.807600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1381/2737] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:18.818081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:18.819523 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:18.875993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec53b-598a-4f35-a118-9aa6935f8834 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:18.879473 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:18.880075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:18.880349 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:18.880616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:18.889359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:18.890791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:18.899618 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1357/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:20.263252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:20.263740 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:20.263855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:20.283080 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] MFA Rules not processed for user `d70c7ea1cb47406585c970d15a3a155b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:20.284269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:20.291097 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1382/2739] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:28.895649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=28 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:29.756836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:29.758232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:29.769963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95202e9-6e1f-493f-bb99-44bd67789b87 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:29.773700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:29.774282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:29.774555 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:29.774822 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:29.776510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:29.846926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:29.848326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798ca17-1679-4ad1-b764-a8efbcf294ca service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:29.860269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1358/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:30.277028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=61 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:31.039518 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:31.049648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4965b-db13-46fb-9fae-3f10817aaa8c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:31.053151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:31.053738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:31.054022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:31.054294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:31.056034 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:31.068914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:31.070321 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf341e3-ecee-4c43-95d3-9d73d558a2a8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:31.081118 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1383/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:23:39.854624 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=34 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:39.937973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:39.938259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:39.938534 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:39.959123 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] MFA Rules not processed for user `d70c7ea1cb47406585c970d15a3a155b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:39.960326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:39.967833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1359/2742] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:41.076219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:49.952485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:23:59.207858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9096-afa6-403a-9656-3602bbed7793 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:59.208442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9096-afa6-403a-9656-3602bbed7793 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:59.208442 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9096-afa6-403a-9656-3602bbed7793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:59.270501 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c6cf9096-afa6-403a-9656-3602bbed7793 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:23:59.271732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c6cf9096-afa6-403a-9656-3602bbed7793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:59.335571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1384/2743] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 12 14:23:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:23:59.382044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:23:59.383488 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:23:59.473616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0820b3-b5cb-4522-98f4-15602bcef413 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:23:59.478905 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:23:59.479551 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:23:59.479831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:23:59.480104 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:23:59.488580 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:23:59.490153 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:23:59.498102 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1360/2744] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:24:01.911964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:01.912887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:01.912887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:01.940600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] MFA Rules not processed for user `4d45164ec1f24346acba53d689c53376`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:01.942189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:02.008771 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1385/2745] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:24:05.000267 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:05.010727 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862bc65-2896-4b3d-b9c1-394015d39acc service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:05.014269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:05.015403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:05.015403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:05.016081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:05.017761 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:05.028232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:05.029900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f86995-4975-41aa-a502-e9b2458807c7 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:05.058628 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1361/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:05.923482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:05.925584 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:05.949685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6f06-bbfc-4fdf-b7ab-dc3046707a47 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:05.959586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:05.962200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:05.963491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:05.964460 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:05.967915 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:05.995416 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:05.997983 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:06.028825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1386/2747] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:14.936398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:14.936891 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:14.937001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:14.958689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] MFA Rules not processed for user `f89941d577024d3e93977851c85e05d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:14.959595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:14.966812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1362/2748] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 12 14:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:14.981314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:14.993036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9b5c4-50ec-4bc3-8def-21f621204d1e service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:14.998468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2c9f5ffc72a45848735d1f5d1f3f25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:14.999187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:14.999563 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:14.999935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:15.009417 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:15.011136 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:15.020296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1387/2749] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 12 14:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 14:24:16.920862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:16.926496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:16.989816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.001410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb9f7-8cc5-49cd-9d73-f90b091d96fd service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.005418 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0c51-a8bf-4248-a116-f80607eba584 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.006421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.007071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.007546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.007816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] PATH_INFO: `/v3/users/d70c7ea1cb47406585c970d15a3a155b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.008906 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70c7ea1cb47406585c970d15a3a155b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.010767 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.010914 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.011547 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.011888 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.012240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.014681 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:17.026968 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.028554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.039342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1363/2750] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:17.054310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:17.065467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70c7ea1cb47406585c970d15a3a155b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.072737 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70c7ea1cb47406585c970d15a3a155b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.073412 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70c7ea1cb47406585c970d15a3a155b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.074042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70c7ea1cb47406585c970d15a3a155b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.086809 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-53b08615-c72a-4f31-9691-db9d041fd5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70c7ea1cb47406585c970d15a3a155b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.098877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1388/2751] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:24:16 2022] DELETE /identity/v3/users/d70c7ea1cb47406585c970d15a3a155b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:24:17.269514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.281425 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ad91-22b5-4451-ae23-49cbcf27ed21 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.320894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:17.339137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.339766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.340040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.340315 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] PATH_INFO: `/v3/projects/d2d9d4e8bb604846b5869dfdd4788fe3` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.341427 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d9d4e8bb604846b5869dfdd4788fe3)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.343368 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.389362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d9d4e8bb604846b5869dfdd4788fe3', 'request_id': 'req-146c3cab-c627-4497-a7ab-ecfb4e663220'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.396359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d9d4e8bb604846b5869dfdd4788fe3', 'request_id': 'req-146c3cab-c627-4497-a7ab-ecfb4e663220'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.401920 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d9d4e8bb604846b5869dfdd4788fe3', 'request_id': 'req-146c3cab-c627-4497-a7ab-ecfb4e663220'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.413353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] The token cache is being invalidate because project d2d9d4e8bb604846b5869dfdd4788fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:24:17.413667 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.414290 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-146c3cab-c627-4497-a7ab-ecfb4e663220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:24:17.415993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1364/2752] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:24:17 2022] DELETE /identity/v3/projects/d2d9d4e8bb604846b5869dfdd4788fe3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:24:17.420755 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.421046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.421324 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.441527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:17.442712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:17.500515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1389/2753] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:17.507977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7007-a311-4582-bff4-166948952f2a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.508266 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7007-a311-4582-bff4-166948952f2a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.508544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7007-a311-4582-bff4-166948952f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.527665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-74db7007-a311-4582-bff4-166948952f2a None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:17.528793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-74db7007-a311-4582-bff4-166948952f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:17.537120 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1365/2754] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:17.541142 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.551296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241383e4-7f7b-4992-ad57-87c84a9cba59 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.555786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.556377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.556657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.556930 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.557571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:24:17.557872 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.559497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.570949 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1390/2755] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:24:17.575333 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7007-a311-4582-bff4-166948952f2a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.584402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7007-a311-4582-bff4-166948952f2a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.588969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.589558 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.589833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.590100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.590720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.592659 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.628800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1366/2756] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:24:17 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:24:17.632870 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.642582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e79147-0cb1-44f9-994e-38ca082453fc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.699393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.699991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.700268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.700537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.701152 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.703660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.723927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1391/2757] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:24:17 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:24:17.728048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.738291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60dca-1560-45e8-8920-e18d5dff3ca6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.742820 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.743450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.743780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.744033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.744666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.746273 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.756752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1367/2758] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:24:17.760568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.770908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861699-10e0-41a8-b9d0-782781141f27 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.775519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.776106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.776386 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.776657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.777293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.778920 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c493d20-7e9e-478f-a45d-65c90ef945b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.789187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1392/2759] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:24:17.793075 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.803231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd7b9-f97e-4a3a-ae45-cfbe06b7bb82 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.807751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.808382 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.808658 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.808929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] PATH_INFO: `/v3/projects/1d94baa1bfe546ccb9a3ef92a4f171f8/users/319be54f9d4f4e2ab8fa989eceeabba7/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.823738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d94baa1bfe546ccb9a3ef92a4f171f8, user_id=319be54f9d4f4e2ab8fa989eceeabba7, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:17.826419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:17.838952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1368/2760] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:24:17 2022] PUT /identity/v3/projects/1d94baa1bfe546ccb9a3ef92a4f171f8/users/319be54f9d4f4e2ab8fa989eceeabba7/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:24:17.843904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51074-d363-4e87-8de4-e94e04521220 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.844185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51074-d363-4e87-8de4-e94e04521220 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.844459 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51074-d363-4e87-8de4-e94e04521220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:17.863874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8cf51074-d363-4e87-8de4-e94e04521220 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:17.865061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8cf51074-d363-4e87-8de4-e94e04521220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:17.878443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:17.924791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1393/2761] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:17.934391 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:17.936403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:17.994287 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ff853-0f63-44cd-a5e0-6870fbba0a08 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:17.997913 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:17.998517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:17.998798 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:17.999129 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:18.007979 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:18.009413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:18.014256 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:18.019973 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1369/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:18.870285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dab72-f1b7-41aa-b4a9-701583cca2a4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:18.870855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dab72-f1b7-41aa-b4a9-701583cca2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:18.870855 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dab72-f1b7-41aa-b4a9-701583cca2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:18.902996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f90dab72-f1b7-41aa-b4a9-701583cca2a4 None None] MFA Rules not processed for user `319be54f9d4f4e2ab8fa989eceeabba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:18.904191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f90dab72-f1b7-41aa-b4a9-701583cca2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:18.974529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1394/2763] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:18.986187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:18.987602 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:19.045027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347b8-0508-4b69-b74b-37c67c1204f4 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:19.049162 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:19.049772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:19.050048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:19.050327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:19.058957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:19.060422 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:19.069163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1370/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:20.439257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:20.439807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:20.439807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:20.459464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] MFA Rules not processed for user `319be54f9d4f4e2ab8fa989eceeabba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:20.460642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:20.467565 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1395/2765] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:20.702033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:20.703510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:20.715289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e555-6837-420a-8a11-1eefd6865725 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:20.719363 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:20.719947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:20.720222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:20.720490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:20.722124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:20.731327 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:20.732741 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:20.741133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1371/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:21.069245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:21.070706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:21.152072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccbd97-107f-43e4-900c-b89f9fc96d0f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:21.157432 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:21.158011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:21.158286 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:21.158552 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:21.160243 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:21.171341 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:21.173562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b25c06-50aa-468f-94c5-dd64b24f0ea4 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:21.183396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1396/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:29.505026 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:29.506533 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:29.581388 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3758f-af55-450b-8c60-ac8590b00f55 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:29.586828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:29.587474 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:29.587757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:29.588027 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:29.589740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:29.602390 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:29.604313 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:29.616568 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1372/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:31.179050 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:39.611467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=66 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:54.125604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e840-6185-4b37-89fd-48b279f29a12 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:54.126093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e840-6185-4b37-89fd-48b279f29a12 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:54.126235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e840-6185-4b37-89fd-48b279f29a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:54.145400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5403e840-6185-4b37-89fd-48b279f29a12 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:54.146595 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5403e840-6185-4b37-89fd-48b279f29a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:54.154491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1397/2769] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:54.171064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:54.172592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:54.186828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d9ad-e203-4916-88b8-19f3b1836ecd service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:54.192490 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:54.193089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:54.193374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:54.193649 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:54.201665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:54.203283 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:54.212496 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1373/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:24:57.163916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ab7f-0c9d-40fc-b6ec-bb86d8b7f0d4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:57.164405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ab7f-0c9d-40fc-b6ec-bb86d8b7f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:57.164405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ab7f-0c9d-40fc-b6ec-bb86d8b7f0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:57.183230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c522ab7f-0c9d-40fc-b6ec-bb86d8b7f0d4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:24:57.184454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c522ab7f-0c9d-40fc-b6ec-bb86d8b7f0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:24:57.192766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1398/2771] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:24:57.206561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:24:57.218196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842d02-3e4a-42fe-97c6-fbdcb4065c8f service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:24:57.223709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:24:57.224299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:24:57.224582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:24:57.224853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:24:57.233029 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:24:57.234595 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:24:57.243778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1374/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:00.406236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8388-96ff-4aed-810d-14c3c7e56598 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:00.406784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8388-96ff-4aed-810d-14c3c7e56598 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:00.406784 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8388-96ff-4aed-810d-14c3c7e56598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:00.425654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0e8c8388-96ff-4aed-810d-14c3c7e56598 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:00.426834 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e8c8388-96ff-4aed-810d-14c3c7e56598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:00.435084 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1399/2773] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:00.450001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:00.461250 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f5a2e-1d17-4c83-adb3-a564cdfe8932 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:00.466703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:00.467331 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:00.467610 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:00.467886 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:00.475813 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:00.477387 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:00.486929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1375/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:03.494555 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0ab-201c-4868-89d2-7ba387dd87f3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:03.495058 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0ab-201c-4868-89d2-7ba387dd87f3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:03.495179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c0ab-201c-4868-89d2-7ba387dd87f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:03.514252 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-06c1c0ab-201c-4868-89d2-7ba387dd87f3 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:03.515466 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-06c1c0ab-201c-4868-89d2-7ba387dd87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:03.523162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1400/2775] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:03.538094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:03.549839 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb2ec6-cc10-405e-b4a9-f63fcec3a056 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:03.555343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:03.555935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:03.556217 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:03.556495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:03.564491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:03.566079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:03.575439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1376/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:07.705901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780eb16-3d36-4521-9ed8-b5468c7fecf6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:07.706445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780eb16-3d36-4521-9ed8-b5468c7fecf6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:07.706445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780eb16-3d36-4521-9ed8-b5468c7fecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:07.725329 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3780eb16-3d36-4521-9ed8-b5468c7fecf6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:07.726520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3780eb16-3d36-4521-9ed8-b5468c7fecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:07.735124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1401/2777] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:07.751454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:07.762384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ce648-81ce-4c1d-a63e-99973a7c3f08 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:07.767895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:07.768492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:07.768774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:07.769051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:07.777034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:07.778615 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:07.787881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1377/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:10.858418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb07c-74a7-4f67-875f-af9cb9cd59ea None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:10.858901 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb07c-74a7-4f67-875f-af9cb9cd59ea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:10.859011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb07c-74a7-4f67-875f-af9cb9cd59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:10.878091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-69ecb07c-74a7-4f67-875f-af9cb9cd59ea None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:10.879296 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-69ecb07c-74a7-4f67-875f-af9cb9cd59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:10.887137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1402/2779] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:10.903777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:10.915006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab6e1-00eb-4b81-a633-e5a0e28d6446 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:10.921145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:10.921854 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:10.922140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:10.922416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:10.930383 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:10.932062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:10.941519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1378/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:20.872768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=18 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:20.937199 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=36 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:25.013693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e09aa-1086-47e2-8ad7-edda9e09992b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:25.014178 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e09aa-1086-47e2-8ad7-edda9e09992b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:25.014290 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e09aa-1086-47e2-8ad7-edda9e09992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:25.033362 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6e5e09aa-1086-47e2-8ad7-edda9e09992b None None] MFA Rules not processed for user `319be54f9d4f4e2ab8fa989eceeabba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:25.034546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6e5e09aa-1086-47e2-8ad7-edda9e09992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:25.041238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1403/2781] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:25:33.114783 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:33.127166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64dcf-f444-476f-8c3a-306cbb01c444 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:33.132850 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:33.133454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:33.133733 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:33.134008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:33.135816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:33.193163 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:33.194674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:33.203450 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1379/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:35.028117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:39.299470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ba97-8c9f-49f8-bdc7-713417eda373 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:39.300115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ba97-8c9f-49f8-bdc7-713417eda373 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:39.300115 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ba97-8c9f-49f8-bdc7-713417eda373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:39.322542 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1411ba97-8c9f-49f8-bdc7-713417eda373 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:39.323704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1411ba97-8c9f-49f8-bdc7-713417eda373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:39.332325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1404/2783] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:39.351190 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:39.362885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20afe-5ae1-4256-80df-900b601a938f service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:39.368918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:39.369566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:39.369829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:39.370097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:39.378230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:39.379894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:39.389094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1380/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:43.616515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319274-6e84-4415-85e6-3d58f228afb6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:43.617021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319274-6e84-4415-85e6-3d58f228afb6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:43.617021 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319274-6e84-4415-85e6-3d58f228afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:43.637230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-00319274-6e84-4415-85e6-3d58f228afb6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:43.638436 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-00319274-6e84-4415-85e6-3d58f228afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:43.646219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1405/2785] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:43.661174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:43.672726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7829e50-348a-4485-a223-23f03c29d446 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:43.678194 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:43.678792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:43.679089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:43.679367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:43.687870 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:43.689436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:43.698638 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1381/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:47.712257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91cc8-2d4a-40f7-9668-ab9fa0e0352c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:47.712748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91cc8-2d4a-40f7-9668-ab9fa0e0352c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:47.712851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91cc8-2d4a-40f7-9668-ab9fa0e0352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:47.732332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-51b91cc8-2d4a-40f7-9668-ab9fa0e0352c None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:47.733527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51b91cc8-2d4a-40f7-9668-ab9fa0e0352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:47.741334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1406/2787] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:47.756187 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:47.768157 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a48c-7c6a-45f0-b4c0-b08fb013c9bf service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:47.773709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:47.774305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:47.774584 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:47.774859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:47.782842 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:47.784459 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:47.793606 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1382/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:51.917966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114839-9037-4fd2-b2b9-0c92f29e3ce6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:51.918521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114839-9037-4fd2-b2b9-0c92f29e3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:51.918714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114839-9037-4fd2-b2b9-0c92f29e3ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:51.938723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-82114839-9037-4fd2-b2b9-0c92f29e3ce6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:51.940169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-82114839-9037-4fd2-b2b9-0c92f29e3ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:51.949578 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1407/2789] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:51.964392 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:51.976098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b1ec-3cb2-4a07-b3cf-3c1b5424dcbe service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:51.982046 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:51.982642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:51.982918 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:51.983233 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:51.993164 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:51.994777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:52.005251 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1383/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:55.076604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:55.077087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:55.077193 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:55.096144 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:55.097337 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:55.105277 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1408/2791] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Sep 12 14:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:55.119115 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:55.130838 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fa8d7-d08b-46ca-b154-24d77fb2326a service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:55.136342 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:55.136970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:55.137281 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:55.137554 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:55.146236 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:55.147895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:55.157072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1384/2792] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:25:55.620124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:55.630447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2553-4e11-4e20-8b71-50336e8b66b6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:55.633972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:55.634575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:55.634852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:55.635197 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:55.636879 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:55.648357 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:55.649769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:55.659167 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1409/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:25:58.757384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:58.759089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:58.772476 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267cc1-023f-4567-9816-8adacc80c538 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:58.777125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:58.777751 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:58.778031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:58.778303 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] PATH_INFO: `/v3/users/4d45164ec1f24346acba53d689c53376` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:58.779451 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d45164ec1f24346acba53d689c53376)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:58.781921 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:58.827436 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d45164ec1f24346acba53d689c53376'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:58.834309 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d45164ec1f24346acba53d689c53376'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:58.834917 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d45164ec1f24346acba53d689c53376'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:58.835566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d45164ec1f24346acba53d689c53376'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:58.843014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0e46a676-3c9a-4147-acd2-a2d9882d8542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d45164ec1f24346acba53d689c53376'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:58.861011 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1385/2794] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:25:58 2022] DELETE /identity/v3/users/4d45164ec1f24346acba53d689c53376 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:25:59.032056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.043117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b900297-3f2a-44ba-826d-b2ca5b4b64be service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.104073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.104732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.105010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.105280 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] PATH_INFO: `/v3/projects/157e042c633348adbae8bc5bbceca8fc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.107899 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157e042c633348adbae8bc5bbceca8fc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.110394 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.161513 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157e042c633348adbae8bc5bbceca8fc', 'request_id': 'req-08fad3d4-231c-4a09-8b54-e61d6c580f30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:59.167260 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157e042c633348adbae8bc5bbceca8fc', 'request_id': 'req-08fad3d4-231c-4a09-8b54-e61d6c580f30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:59.175396 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157e042c633348adbae8bc5bbceca8fc', 'request_id': 'req-08fad3d4-231c-4a09-8b54-e61d6c580f30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:59.189492 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] The token cache is being invalidate because project 157e042c633348adbae8bc5bbceca8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:25:59.189778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:59.190431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-08fad3d4-231c-4a09-8b54-e61d6c580f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:25:59.192149 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1410/2795] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:25:59 2022] DELETE /identity/v3/projects/157e042c633348adbae8bc5bbceca8fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:25:59.197270 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.197646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.197996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.207966 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:59.220970 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:59.222612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:59.284094 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1386/2796] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:25:59.292969 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.293250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.293523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.313998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:59.315242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:59.323275 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1411/2797] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:25:59.327492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.336930 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77eef4-fb68-4ba8-a851-49fdeb8e0ba2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.341424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.342018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.342302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.342599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.343274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:25:59.343577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.345171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.356514 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1387/2798] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:25:59.361457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.370468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c91ff4-e2f2-41e9-ab86-833b24248c97 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.375699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.376283 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.376559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.376824 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.377441 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.379347 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.406591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1412/2799] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:25:59 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:25:59.410544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.420337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8534b-8997-4017-ab7a-5d2b2748e30d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.475878 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.476484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.476762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.477036 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.477673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.479621 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.506063 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1388/2800] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:25:59 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:25:59.507355 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.518407 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab495-fb03-446d-9cdf-317821b72c11 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.523215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.523884 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.524231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.524504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.525147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.526712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.537212 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1413/2801] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:25:59.541049 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.551491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec77ff-e144-4977-ab6b-bb6e97a19ba8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.556260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.556688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.556962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.557218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.557869 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.559500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbcdf-fc6c-4949-9507-c61bf0c621d4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.571108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1389/2802] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:25:59.575371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.582206 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:59.586400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398bf1-280e-4a96-aa41-1a2484efd0be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.592596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.593517 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.594007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.594445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] PATH_INFO: `/v3/projects/4a657e3e3a3743e284eb1ec4fcd103cd/users/207b875806e94538af96af04a9a26928/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.609806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a657e3e3a3743e284eb1ec4fcd103cd, user_id=207b875806e94538af96af04a9a26928, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.612526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.625944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1414/2803] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:25:59 2022] PUT /identity/v3/projects/4a657e3e3a3743e284eb1ec4fcd103cd/users/207b875806e94538af96af04a9a26928/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:25:59.631183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378f85f-5c9a-4834-bcca-987126778c54 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.631470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378f85f-5c9a-4834-bcca-987126778c54 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.631745 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378f85f-5c9a-4834-bcca-987126778c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.657408 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6378f85f-5c9a-4834-bcca-987126778c54 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:25:59.659182 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6378f85f-5c9a-4834-bcca-987126778c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:59.724829 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1390/2804] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:25:59.734773 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:25:59.736581 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:25:59.795464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4e01-b6cf-4c27-85d7-3b06ec8662aa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:25:59.799727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:25:59.800384 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:25:59.800663 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:25:59.800933 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:25:59.809976 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:25:59.812071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:25:59.821904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1415/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:26:00.479062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.479570 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.479684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.500700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:00.510362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] MFA Rules not processed for user `207b875806e94538af96af04a9a26928`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:00.512133 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:00.580240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1391/2806] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:00.584512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.594851 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fba9-2701-4494-ba08-36638e35a0c6 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.599360 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.600007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.600225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.600494 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.601579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.603382 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.629865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1416/2807] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:00 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:00.633868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.645350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f070f-6085-4b01-88d5-0f3db9b00af3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.701308 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.702498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.702799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.703107 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.703746 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.705684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.727456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1392/2808] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:00 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:00.731491 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.742036 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c019a-da05-420d-8701-39aa7025ab8a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.746623 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.747322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.747604 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.747877 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.748516 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.750122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.760546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1417/2809] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:00.765090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.775009 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d861-ff70-47f4-903c-3fa9d9342b77 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.779962 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.781125 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.781404 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.781677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] PATH_INFO: `/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231/users/9fdd432e47ba4268869d15fb9970e7bc/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.796245 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d291f9a380dd4df9aa8c4ea6b3f05231, user_id=9fdd432e47ba4268869d15fb9970e7bc, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.798903 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.811983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1393/2810] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:00 2022] PUT /identity/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231/users/9fdd432e47ba4268869d15fb9970e7bc/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:00.816098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.826042 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357913e-9e23-4ee3-ab0c-404b4c5b9bfd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.885507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.886113 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.886393 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.886673 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.887344 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.888918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1188bc-07bc-4d80-b8a8-cb40447d97a7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.899397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1418/2811] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:00.903788 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:00.914142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90375d8-3b56-4bca-a550-84fdf185a8ec admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:00.918771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:00.919440 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:00.919717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:00.919980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] PATH_INFO: `/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231/users/9fdd432e47ba4268869d15fb9970e7bc/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:00.922380 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d291f9a380dd4df9aa8c4ea6b3f05231, user_id=9fdd432e47ba4268869d15fb9970e7bc, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:00.925173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:00.935636 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1394/2812] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:00 2022] PUT /identity/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231/users/9fdd432e47ba4268869d15fb9970e7bc/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:01.593165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626492-546b-4f83-8813-09a057de873c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:01.593165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626492-546b-4f83-8813-09a057de873c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:01.593165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626492-546b-4f83-8813-09a057de873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:01.623671 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d626492-546b-4f83-8813-09a057de873c None None] MFA Rules not processed for user `9fdd432e47ba4268869d15fb9970e7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:01.625672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d626492-546b-4f83-8813-09a057de873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:01.660370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:01.702465 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1419/2813] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:01 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:02.766924 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:02.819294 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:02.830844 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf91d-dbf4-4e4f-995f-4152b2d0f410 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:02.835452 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:02.836072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:02.836346 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:02.836612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] PATH_INFO: `/v3/users/207b875806e94538af96af04a9a26928` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:02.837703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207b875806e94538af96af04a9a26928)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:02.839665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:02.884355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207b875806e94538af96af04a9a26928'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:02.891859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207b875806e94538af96af04a9a26928'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:02.892466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207b875806e94538af96af04a9a26928'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:02.893057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207b875806e94538af96af04a9a26928'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:02.899811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207b875806e94538af96af04a9a26928'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:02.916932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1395/2814] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:02 2022] DELETE /identity/v3/users/207b875806e94538af96af04a9a26928 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:03.090217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626492-546b-4f83-8813-09a057de873c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.102582 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626492-546b-4f83-8813-09a057de873c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:03.162797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:03.163433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.163719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.163991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] PATH_INFO: `/v3/projects/4a657e3e3a3743e284eb1ec4fcd103cd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.165090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a657e3e3a3743e284eb1ec4fcd103cd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:03.167057 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:03.212712 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a657e3e3a3743e284eb1ec4fcd103cd', 'request_id': 'req-065c0a83-b681-4368-a484-b29442c95305'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.218154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a657e3e3a3743e284eb1ec4fcd103cd', 'request_id': 'req-065c0a83-b681-4368-a484-b29442c95305'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.226215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a657e3e3a3743e284eb1ec4fcd103cd', 'request_id': 'req-065c0a83-b681-4368-a484-b29442c95305'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.237655 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] The token cache is being invalidate because project 4a657e3e3a3743e284eb1ec4fcd103cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:03.237936 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.238560 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.240056 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1420/2815] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:03 2022] DELETE /identity/v3/projects/4a657e3e3a3743e284eb1ec4fcd103cd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:03.244101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.245487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:03.263685 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086f7db-34d6-4017-846c-fc72d5377472 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:03.320020 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:03.320650 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.320928 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.321206 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] PATH_INFO: `/v3/users/9fdd432e47ba4268869d15fb9970e7bc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.322336 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdd432e47ba4268869d15fb9970e7bc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:03.324304 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:03.371367 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdd432e47ba4268869d15fb9970e7bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.379414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdd432e47ba4268869d15fb9970e7bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.380204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdd432e47ba4268869d15fb9970e7bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.380824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdd432e47ba4268869d15fb9970e7bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.387947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-5201c502-7b7f-4317-85ab-6908847bfb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdd432e47ba4268869d15fb9970e7bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.395843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:03.407307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1396/2816] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:03 2022] DELETE /identity/v3/users/9fdd432e47ba4268869d15fb9970e7bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:03.578550 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.580122 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:03.593826 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0a83-b681-4368-a484-b29442c95305 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:03.651805 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:03.652438 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.652719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.652992 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] PATH_INFO: `/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.654091 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d291f9a380dd4df9aa8c4ea6b3f05231)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:03.656046 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:03.658269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:03.703667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd291f9a380dd4df9aa8c4ea6b3f05231', 'request_id': 'req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.709071 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd291f9a380dd4df9aa8c4ea6b3f05231', 'request_id': 'req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.716353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd291f9a380dd4df9aa8c4ea6b3f05231', 'request_id': 'req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.727403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] The token cache is being invalidate because project d291f9a380dd4df9aa8c4ea6b3f05231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:03.727689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.728305 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4aae67b-9d5b-4daf-8589-ade527f4dfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:03.729766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1421/2817] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:03 2022] DELETE /identity/v3/projects/d291f9a380dd4df9aa8c4ea6b3f05231 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:03.734946 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.735268 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.735574 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.754983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:03.756193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:03.813969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1397/2818] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:03.822977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.823377 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.823657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.843521 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:03.844719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:03.852601 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1422/2819] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:26:03.856834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.866699 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce336c48-c986-4847-8ec6-b55a22559836 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:03.871557 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:03.872234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.872519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.872799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.873447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:26:03.874241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:03.875883 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:03.887424 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1398/2820] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:26:03.892402 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.902141 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cbb76-0920-4ad5-9cfe-5d8561042322 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:03.906908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:03.907528 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:03.907806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:03.908077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:03.908701 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:03.910579 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:03.938022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1423/2821] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:03 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:03.942277 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:03.953860 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09bf27-41fe-40d7-98b7-6465c86f2e0d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.009047 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.009666 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.009927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.010201 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.010832 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.012863 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.033706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1399/2822] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:03 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:04.038135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.049051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8cb0e-dd2c-41a8-b7fd-13ea7a8389c1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.053557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.054147 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.054421 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.054688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.055392 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.057278 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.067793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1424/2823] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:04.071778 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.081593 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb5cf-6106-4abd-95de-5a650efd59f9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.086255 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.086853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.087178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.087458 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.088101 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.089730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e4d74-8ce0-4289-af15-c533153fe333 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.100062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1400/2824] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:04.104072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.115457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68d49-1a50-48b2-ae94-9d2bb27663c9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.120073 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.120719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.120997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.121269 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] PATH_INFO: `/v3/projects/36f0961a5c7d4437a79181a348a1e48f/users/a384b48a4773451fba530c8fe0a37611/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.136529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f0961a5c7d4437a79181a348a1e48f, user_id=a384b48a4773451fba530c8fe0a37611, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.139172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.152316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1425/2825] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:04 2022] PUT /identity/v3/projects/36f0961a5c7d4437a79181a348a1e48f/users/a384b48a4773451fba530c8fe0a37611/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:04.162544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.162834 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.163146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.191503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] MFA Rules not processed for user `a384b48a4773451fba530c8fe0a37611`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:04.192708 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:04.237958 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:04.259730 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1401/2826] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:04.263974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.329435 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7676-ad5b-419c-a9c5-73161888ad83 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.334092 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.334694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.334972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.335273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.335932 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.337827 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.365098 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1426/2827] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:04 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:04.370178 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.381971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315c3d5-9986-49bf-af23-8d6ed249db69 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.439528 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.440145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.440423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.440689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.441353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.443265 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.464887 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1402/2828] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:04 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:04.469070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.480839 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f59e5-55ac-47ec-a526-3ebd4ab8d2c3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.486158 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.486698 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.486972 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.487273 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.487916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.489497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.501162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1427/2829] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:04.505582 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.518590 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94587e-bdd3-4be2-b927-c7e7f7025506 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.524297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.524967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.525254 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.525535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] PATH_INFO: `/v3/projects/010a795f78c44896a1f5556a07b2d20d/users/b7158fbe9e77443cbb76e7ef9d2b20c7/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.542507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010a795f78c44896a1f5556a07b2d20d, user_id=b7158fbe9e77443cbb76e7ef9d2b20c7, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.545218 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.560030 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1403/2830] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:04 2022] PUT /identity/v3/projects/010a795f78c44896a1f5556a07b2d20d/users/b7158fbe9e77443cbb76e7ef9d2b20c7/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:04.565196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.571378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:04.579648 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496dd2-d6c4-49a1-a7e7-7ce36ed4e4ce admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.666274 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.667342 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.667726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.668099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.669858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.671966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c039256-62a7-471b-8628-d0b50aec3d58 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.685211 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1428/2831] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:04.693753 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.715316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f8ec-e50a-4ac3-a523-ab4026b76ab6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.720456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.721208 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.721563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.721908 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] PATH_INFO: `/v3/projects/010a795f78c44896a1f5556a07b2d20d/users/b7158fbe9e77443cbb76e7ef9d2b20c7/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.724083 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=010a795f78c44896a1f5556a07b2d20d, user_id=b7158fbe9e77443cbb76e7ef9d2b20c7, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.726717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.738414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1404/2832] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:04 2022] PUT /identity/v3/projects/010a795f78c44896a1f5556a07b2d20d/users/b7158fbe9e77443cbb76e7ef9d2b20c7/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:04.748531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.749364 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.749660 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.778192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] MFA Rules not processed for user `b7158fbe9e77443cbb76e7ef9d2b20c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:04.779588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:04.849757 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1429/2833] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:04.861868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:04.863672 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:04.919524 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6c23c-ce44-4eb9-8a46-a97a5c02b1fb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:04.923642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:04.924234 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:04.924512 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:04.924781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:04.933413 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:04.934830 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:04.944768 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1405/2834] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:05.021401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:05.031681 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957efa2-b7e2-470d-b6bb-d287025a1f18 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:05.035285 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:05.035888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:05.036171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:05.036450 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:05.096261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:05.097726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9545027-6cb0-452a-a1a6-0a7535e535c9 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:05.112168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1430/2835] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:11.874169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:11.917334 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:11.939897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3de52-c255-40fb-aca0-740277aaff4f service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:11.944754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:11.945421 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:11.945828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:11.946108 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] PATH_INFO: `/v3/users/a384b48a4773451fba530c8fe0a37611` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:11.947771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a384b48a4773451fba530c8fe0a37611)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:11.950249 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:11.997278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a384b48a4773451fba530c8fe0a37611'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.004522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a384b48a4773451fba530c8fe0a37611'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.005134 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a384b48a4773451fba530c8fe0a37611'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.005742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a384b48a4773451fba530c8fe0a37611'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.012609 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a384b48a4773451fba530c8fe0a37611'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.029560 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1406/2836] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:11 2022] DELETE /identity/v3/users/a384b48a4773451fba530c8fe0a37611 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:12.034686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:12.035179 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:12.035297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:12.054505 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:12.055743 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:12.074336 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:12.117314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1431/2837] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:26:12.126902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:12.128397 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:12.186633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c137cd-d0c2-40cc-a458-cd7d5c1c164f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:12.190222 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:12.190824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:12.191139 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:12.191414 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:12.200565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:12.202067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:12.212166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1407/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:12.481979 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:12.483850 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:12.496683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158a3b4-edef-4a37-8c85-d5b2c8edc4bc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:12.501383 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:12.502076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:12.502354 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:12.502626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] PATH_INFO: `/v3/projects/36f0961a5c7d4437a79181a348a1e48f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:12.503782 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f0961a5c7d4437a79181a348a1e48f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:12.505721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:12.552605 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f0961a5c7d4437a79181a348a1e48f', 'request_id': 'req-7495c25f-e9f4-469f-a7ab-2d4df9c46261'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.558048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f0961a5c7d4437a79181a348a1e48f', 'request_id': 'req-7495c25f-e9f4-469f-a7ab-2d4df9c46261'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.565724 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f0961a5c7d4437a79181a348a1e48f', 'request_id': 'req-7495c25f-e9f4-469f-a7ab-2d4df9c46261'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.576638 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] The token cache is being invalidate because project 36f0961a5c7d4437a79181a348a1e48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:12.576927 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.577557 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.579063 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1432/2839] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:12 2022] DELETE /identity/v3/projects/36f0961a5c7d4437a79181a348a1e48f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:12.583509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:12.593066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ae01-2bab-4393-a7e9-7c336047c779 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:12.650008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:12.650648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:12.650929 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:12.651758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] PATH_INFO: `/v3/users/b7158fbe9e77443cbb76e7ef9d2b20c7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:12.653090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7158fbe9e77443cbb76e7ef9d2b20c7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:12.655278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:12.660114 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:12.703276 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7158fbe9e77443cbb76e7ef9d2b20c7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.710912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7158fbe9e77443cbb76e7ef9d2b20c7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.711566 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7158fbe9e77443cbb76e7ef9d2b20c7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.712161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7158fbe9e77443cbb76e7ef9d2b20c7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.718957 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db613932-b994-4498-ada4-d54a04bec44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7158fbe9e77443cbb76e7ef9d2b20c7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:12.735772 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1408/2840] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:12 2022] DELETE /identity/v3/users/b7158fbe9e77443cbb76e7ef9d2b20c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:13.002800 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.004256 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:13.018328 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c25f-e9f4-469f-a7ab-2d4df9c46261 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.074370 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.074998 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.075297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.075567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] PATH_INFO: `/v3/projects/010a795f78c44896a1f5556a07b2d20d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.076658 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=010a795f78c44896a1f5556a07b2d20d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.078617 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.123748 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:13.125119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010a795f78c44896a1f5556a07b2d20d', 'request_id': 'req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:13.132624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010a795f78c44896a1f5556a07b2d20d', 'request_id': 'req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:13.139943 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010a795f78c44896a1f5556a07b2d20d', 'request_id': 'req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:13.150858 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] The token cache is being invalidate because project 010a795f78c44896a1f5556a07b2d20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:13.151160 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:13.151777 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a92a044-3ed4-4da1-8c5d-5e63fad1d4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:13.153253 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1433/2841] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:13 2022] DELETE /identity/v3/projects/010a795f78c44896a1f5556a07b2d20d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:13.159054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.159542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.159644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.179477 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:13.180676 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:13.238166 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1409/2842] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:13.245978 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.246259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.246534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.266526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:13.267761 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:13.275597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1434/2843] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:13.279833 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.290082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49721-d1b3-41d7-bcc7-9c2d2490526d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.295945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.296700 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.297329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.297522 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.298799 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:26:13.299159 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.300824 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.314816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1410/2844] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:26:13.319322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.328575 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ddf00-e656-46c7-a1c6-4b403050f248 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.333266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.333802 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.334079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.334361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.334974 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.337134 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.371075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1435/2845] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:13.372377 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.382774 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482c32-0f69-479a-bbec-a5299117ade4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.439614 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.440215 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.440498 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.440770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.441385 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.443326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.460495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:13.470326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1411/2846] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:13.471564 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.482007 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44532f15-9dbd-49c4-8bea-e8a415506fa0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.488162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.488843 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.489177 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.489456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.490101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.491721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.501941 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1436/2847] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:13.506130 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.518000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91febfc-8c9f-432d-a938-af4bb83280bb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.522837 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.523466 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.523740 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.524010 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.524647 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.526239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084767d-5dda-4cb4-9501-3b8dc0fa2797 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.543594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1412/2848] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:13.545361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.557415 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb27a-0243-4c49-b0c8-c15177adbf64 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.562921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.563786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.564264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.564548 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] PATH_INFO: `/v3/projects/a04bba72df744e7985666998202550d1/users/5e5aa2b1201a4b069c2629f2087fcb31/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.579975 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bba72df744e7985666998202550d1, user_id=5e5aa2b1201a4b069c2629f2087fcb31, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.582823 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.599428 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1437/2849] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:13 2022] PUT /identity/v3/projects/a04bba72df744e7985666998202550d1/users/5e5aa2b1201a4b069c2629f2087fcb31/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:13.611008 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.611318 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.611588 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.643665 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] MFA Rules not processed for user `5e5aa2b1201a4b069c2629f2087fcb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:13.644910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:13.717910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1413/2850] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:13.723061 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.785903 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe2f-bbaf-418f-af0e-47821ab773d8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.790596 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.791238 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.791520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.791792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.792447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.794339 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.821962 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1438/2851] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:13.826317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.836847 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b184b-a362-4617-a733-0159b00bfd9b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.894981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.895542 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.895819 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.896105 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.896722 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.898637 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.920209 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1414/2852] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:13 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:13.924361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.934687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd64648-ce61-4c3f-9428-c9a54f0c401f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.939410 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.940013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.940294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.940568 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.941214 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.942829 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:13.954787 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1439/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:13.958954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:13.968932 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a384-ad85-4e48-a155-82886c446055 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:13.974082 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:13.974719 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:13.974995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:13.975296 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] PATH_INFO: `/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d/users/10c4649a405b4ef88c24219da00fbf5f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:13.989694 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=955aeb2ba2ca403aac2b5c61a7e94d3d, user_id=10c4649a405b4ef88c24219da00fbf5f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:13.992359 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:14.004521 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1415/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:13 2022] PUT /identity/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d/users/10c4649a405b4ef88c24219da00fbf5f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:14.008535 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:14.018738 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522da7-7f46-44f4-a303-bc802e96a412 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:14.061331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:14.076245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:14.076923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:14.077117 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:14.077389 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:14.078025 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:14.080242 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e381e-b99f-4fba-864e-ed2a7e296c6a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:14.089900 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1440/2855] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:14.094061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:14.104310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420153-4a6f-492a-a63a-d316e33d94ed admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:14.109231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:14.109877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:14.110155 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:14.110428 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] PATH_INFO: `/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d/users/10c4649a405b4ef88c24219da00fbf5f/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:14.112335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955aeb2ba2ca403aac2b5c61a7e94d3d, user_id=10c4649a405b4ef88c24219da00fbf5f, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:14.114991 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:14.125188 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1416/2856] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:14 2022] PUT /identity/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d/users/10c4649a405b4ef88c24219da00fbf5f/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:14.193081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:14.193270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:14.193537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:14.222405 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] MFA Rules not processed for user `10c4649a405b4ef88c24219da00fbf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:14.223645 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:14.289825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1441/2857] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:14.300867 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:14.302563 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:14.337168 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:14.361715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155887a-f802-45fc-942c-1222c2305492 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:14.365343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:14.365949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:14.366231 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:14.366506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:14.375352 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:14.377269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:14.386483 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1417/2858] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:14.432334 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:14.433711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:14.446087 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843a46d-3d7e-4555-9bd0-e104a532b5e1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:14.449678 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:14.450267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:14.450546 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:14.450815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:14.505847 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:14.507298 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd66ab-149d-40b1-859b-85eb00bf2e4b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:14.515952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1442/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:17.793689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:17.853310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a407a-6147-4c9f-8461-f73b741247a5 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:17.858053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:17.858704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:17.858983 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:17.859291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] PATH_INFO: `/v3/users/5e5aa2b1201a4b069c2629f2087fcb31` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:17.860429 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5aa2b1201a4b069c2629f2087fcb31)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:17.863054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:17.905899 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5aa2b1201a4b069c2629f2087fcb31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:17.912639 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5aa2b1201a4b069c2629f2087fcb31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:17.913345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5aa2b1201a4b069c2629f2087fcb31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:17.913949 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5aa2b1201a4b069c2629f2087fcb31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:17.920721 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5aa2b1201a4b069c2629f2087fcb31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:17.938305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1418/2860] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:17 2022] DELETE /identity/v3/users/5e5aa2b1201a4b069c2629f2087fcb31 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:17.942995 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:17.943496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:17.943589 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:17.963786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:17.964984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:18.023304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1443/2861] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:18.032990 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:18.034952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:18.090922 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fee46-1b49-464e-b9d3-fcba9b49a57e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:18.094589 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:18.095227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:18.095508 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:18.095782 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:18.103002 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:18.105389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:18.108098 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:18.123664 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1419/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:18.399706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:18.401146 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:18.413704 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650851d-0546-4af2-bc1e-9c277fe8bb1b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:18.418387 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:18.418921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:18.419231 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:18.419509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] PATH_INFO: `/v3/projects/a04bba72df744e7985666998202550d1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:18.420654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04bba72df744e7985666998202550d1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:18.422558 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:18.424221 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:18.472574 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04bba72df744e7985666998202550d1', 'request_id': 'req-576862cb-020c-42ba-b941-a1c41be4e4cc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.478210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04bba72df744e7985666998202550d1', 'request_id': 'req-576862cb-020c-42ba-b941-a1c41be4e4cc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.485867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04bba72df744e7985666998202550d1', 'request_id': 'req-576862cb-020c-42ba-b941-a1c41be4e4cc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.496935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] The token cache is being invalidate because project a04bba72df744e7985666998202550d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:18.497225 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.497853 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.499353 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1444/2863] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:18 2022] DELETE /identity/v3/projects/a04bba72df744e7985666998202550d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:18.503927 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:18.513310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64980fd9-86e5-4970-bba3-1e60554c2981 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:18.568158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:18.568784 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:18.569066 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:18.569339 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] PATH_INFO: `/v3/users/10c4649a405b4ef88c24219da00fbf5f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:18.570460 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c4649a405b4ef88c24219da00fbf5f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:18.572430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:18.618947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c4649a405b4ef88c24219da00fbf5f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.625961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c4649a405b4ef88c24219da00fbf5f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.626565 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c4649a405b4ef88c24219da00fbf5f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.627786 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c4649a405b4ef88c24219da00fbf5f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.634717 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-53557337-74e6-4bf6-ac01-3f7d8a4bd6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c4649a405b4ef88c24219da00fbf5f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:18.653044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1420/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:18 2022] DELETE /identity/v3/users/10c4649a405b4ef88c24219da00fbf5f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:18.933611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:18.935070 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:18.952874 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576862cb-020c-42ba-b941-a1c41be4e4cc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.010078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.010637 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.010918 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.011222 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] PATH_INFO: `/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.012728 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955aeb2ba2ca403aac2b5c61a7e94d3d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.014249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.059699 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955aeb2ba2ca403aac2b5c61a7e94d3d', 'request_id': 'req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:19.065733 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955aeb2ba2ca403aac2b5c61a7e94d3d', 'request_id': 'req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:19.072812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955aeb2ba2ca403aac2b5c61a7e94d3d', 'request_id': 'req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:19.083886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] The token cache is being invalidate because project 955aeb2ba2ca403aac2b5c61a7e94d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:19.084175 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:19.084795 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d2a2b73a-5832-4ba6-9cbe-6801172c9ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:19.086267 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1445/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:18 2022] DELETE /identity/v3/projects/955aeb2ba2ca403aac2b5c61a7e94d3d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:19.091284 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.091797 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.091895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.111204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:19.112935 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:19.171577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1421/2866] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:19.179569 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.179852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.180128 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.200126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:19.201454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:19.211244 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1446/2867] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:19.215239 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.224703 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525c35-5900-44a2-9bda-66eb1cc5e33e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.229171 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.229765 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.230039 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.230306 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.230938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:26:19.231274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.233126 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.244785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1422/2868] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 14:26:19.248907 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.258682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1baf45-f7b1-4eb0-a976-9a2e91fc7077 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.263531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.264053 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.264318 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.264585 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.265216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.267119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.278307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:19.295807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1447/2869] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:19.300487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.305569 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:19.312121 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208373e1-c758-433b-9af3-316299e54f8d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.369980 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.370594 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.370894 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.371274 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.371938 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.373871 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.398149 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1423/2870] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:19.399443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.410408 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77eed-b748-4bfc-8faa-04e90e36c0c1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.415502 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.416112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.416391 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.416667 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.417308 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.418891 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.430404 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1448/2871] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:19.435154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.447836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026038-710a-41aa-bcea-33126c6d8fa4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.452648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.453260 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.453543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.453815 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.454456 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.456419 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13042d4-ae19-466e-8af1-328d2b774bce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.466885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1424/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:19.471682 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.481986 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67458db-e3db-46b2-884e-0e7fafdc88dd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.487371 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.488013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.488288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.488567 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] PATH_INFO: `/v3/projects/06df2469852a438a923f95e7974ba225/users/399159209bc64116be3deaf6faec0287/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.502964 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06df2469852a438a923f95e7974ba225, user_id=399159209bc64116be3deaf6faec0287, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.505935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.518865 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1449/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:19 2022] PUT /identity/v3/projects/06df2469852a438a923f95e7974ba225/users/399159209bc64116be3deaf6faec0287/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:19.530326 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.530642 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.530912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.560048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] MFA Rules not processed for user `399159209bc64116be3deaf6faec0287`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:19.561230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:19.630435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1425/2874] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:19.634889 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.695279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1874-caa5-4f7b-8aca-8448e191738a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.699921 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.700520 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.700804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.701076 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.701706 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.703644 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.729449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1450/2875] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:19.733749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.744549 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079db9-b214-422b-a6f9-a231b4cdd1bb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.799757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.800292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.800572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.800872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.801506 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.803470 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.820471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:19.828759 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1426/2876] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:19 2022] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:19.830016 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.840629 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e721f9-bd3e-42e4-a09f-f61e9b4417a0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.845218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.845820 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.846693 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.846967 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.847641 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.849219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.860866 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1451/2877] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:19.864762 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.874416 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de582-2aad-4edf-b01a-3b46a4e04cfd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.879137 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.879859 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.880263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.880543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] PATH_INFO: `/v3/projects/86d564f684534cd1b10fe2406059302a/users/eb9df709f87640f99e2959d7e6695908/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.895357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d564f684534cd1b10fe2406059302a, user_id=eb9df709f87640f99e2959d7e6695908, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.898022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.911240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1427/2878] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:19 2022] PUT /identity/v3/projects/86d564f684534cd1b10fe2406059302a/users/eb9df709f87640f99e2959d7e6695908/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:19.915121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:19.924924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89407-ca84-4958-ba22-37e4cad9204b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:19.980482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:19.981150 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:19.981461 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:19.981685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:19.982268 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:19.984124 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0579f75-1357-49da-a82d-d2327b82b5d1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:19.993788 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1452/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:19.997919 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:20.008611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709c70-bb25-44a2-8051-3d2834e34572 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:20.013259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:20.013909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:20.014189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:20.014462 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] PATH_INFO: `/v3/projects/86d564f684534cd1b10fe2406059302a/users/eb9df709f87640f99e2959d7e6695908/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:20.016396 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d564f684534cd1b10fe2406059302a, user_id=eb9df709f87640f99e2959d7e6695908, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:20.019724 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:20.029654 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1428/2880] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:19 2022] PUT /identity/v3/projects/86d564f684534cd1b10fe2406059302a/users/eb9df709f87640f99e2959d7e6695908/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:20.040857 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:20.041169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:20.041443 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:20.068908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] MFA Rules not processed for user `eb9df709f87640f99e2959d7e6695908`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:20.070031 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:20.082869 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:20.143649 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1453/2881] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:20.154161 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:20.155942 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:20.211846 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ded-5168-45cd-9333-71109a30d433 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:20.215467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:20.216065 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:20.216343 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:20.216616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:20.225406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:20.226828 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:20.236253 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1429/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:20.309373 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:20.319422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa642b34-5799-4956-a3c0-f5df4aa1093f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:20.322895 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:20.323529 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:20.323804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:20.324072 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:20.380094 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:20.381551 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:20.390482 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1454/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:23.445335 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:23.447948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:23.514926 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25613824-86c5-4b5f-af1d-d96bba9cf720 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:23.519539 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:23.520193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:23.520471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:23.520749 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] PATH_INFO: `/v3/users/319be54f9d4f4e2ab8fa989eceeabba7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:23.521900 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] RBAC: Authorizing `identity:delete_user(user_id=319be54f9d4f4e2ab8fa989eceeabba7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:23.523856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:23.573112 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319be54f9d4f4e2ab8fa989eceeabba7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.580544 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319be54f9d4f4e2ab8fa989eceeabba7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.581263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319be54f9d4f4e2ab8fa989eceeabba7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.581872 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319be54f9d4f4e2ab8fa989eceeabba7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.588812 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fbc21b01-2882-4565-8f59-7541809f197d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319be54f9d4f4e2ab8fa989eceeabba7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.593193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:23.608780 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1430/2884] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:23 2022] DELETE /identity/v3/users/319be54f9d4f4e2ab8fa989eceeabba7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:23.809547 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:23.820597 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f328-5d3b-42b8-a5d9-178dcd013a10 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:23.880507 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:23.881143 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:23.881467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:23.881718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] PATH_INFO: `/v3/projects/1d94baa1bfe546ccb9a3ef92a4f171f8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:23.882908 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d94baa1bfe546ccb9a3ef92a4f171f8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:23.884844 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:23.929937 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d94baa1bfe546ccb9a3ef92a4f171f8', 'request_id': 'req-19645782-04e1-4208-96de-4dd94197ae17'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.931793 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:23.936203 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d94baa1bfe546ccb9a3ef92a4f171f8', 'request_id': 'req-19645782-04e1-4208-96de-4dd94197ae17'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.942990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d94baa1bfe546ccb9a3ef92a4f171f8', 'request_id': 'req-19645782-04e1-4208-96de-4dd94197ae17'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.955264 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] The token cache is being invalidate because project 1d94baa1bfe546ccb9a3ef92a4f171f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:23.955549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.956219 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-19645782-04e1-4208-96de-4dd94197ae17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:23.957711 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1455/2885] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:23 2022] DELETE /identity/v3/projects/1d94baa1bfe546ccb9a3ef92a4f171f8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:23.962545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:23.962831 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:23.963144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:23.983357 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:23.984536 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.046656 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1431/2886] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:24.056114 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.056403 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.056683 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.077527 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:24.079171 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.088485 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1456/2887] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:24.092977 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.102995 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b41709-9cf3-4b78-8f2d-f8386af8bcb4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.108054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.108669 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.108945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.109214 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.109853 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:26:24.110152 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.112487 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.124059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1432/2888] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:26:24.128413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.137685 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d079d-a8cf-46f4-a8cc-4fa32383ce38 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.142445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.143562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.143838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.144106 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.144766 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.146646 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.173361 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1457/2889] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:24 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:24.177471 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.187381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b880-84eb-43e2-84cf-693426cc241c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.242877 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.243517 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.243795 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.244064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.244689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.246599 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.267023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1433/2890] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:24 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:24.271756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.282172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e082b-2667-4904-8156-4eda12ff2980 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.287322 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.287912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.288185 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.288454 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.289090 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.290657 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.300369 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1458/2891] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:24.304099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.313629 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6773f0d-5109-451a-adb4-1a6309c02344 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.318124 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.318704 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.318982 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.319289 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.319915 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.321622 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0951-eb07-4ad7-a9d1-9e0627d4f525 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.335364 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1434/2892] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:24.336716 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.347833 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594e284-f363-4162-b3c3-0efd475af48a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.352352 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.353013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.353297 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.353576 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] PATH_INFO: `/v3/projects/166b6ba5dcc642f3a8b033e3ba2293c5/users/5e0fe894b2ba46d0adc6050295a4126d/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.369418 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=166b6ba5dcc642f3a8b033e3ba2293c5, user_id=5e0fe894b2ba46d0adc6050295a4126d, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.372123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.386010 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1459/2893] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:24 2022] PUT /identity/v3/projects/166b6ba5dcc642f3a8b033e3ba2293c5/users/5e0fe894b2ba46d0adc6050295a4126d/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:24.391600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.391937 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.392240 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.414004 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:24.415237 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.463257 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:24.484952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1435/2894] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:24.486251 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.488077 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.491518 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.492836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.501192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22c1-2f57-4bf6-b15e-e988deb10e9c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.506504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.507246 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.507603 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.507950 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] PATH_INFO: `/v3/users/399159209bc64116be3deaf6faec0287` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.509095 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=399159209bc64116be3deaf6faec0287)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.511022 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.551864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2178-3cd6-46e7-9d08-124976f3d730 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.555592 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.556193 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.556467 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.556739 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.560821 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399159209bc64116be3deaf6faec0287'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:24.565901 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.567381 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ac0c1-dade-4560-a5ad-35a55008fd5f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.568317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399159209bc64116be3deaf6faec0287'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:24.569083 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399159209bc64116be3deaf6faec0287'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:24.569904 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399159209bc64116be3deaf6faec0287'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:24.577038 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1436/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:26:24.584448 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399159209bc64116be3deaf6faec0287'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:24.598825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1460/2896] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:24 2022] DELETE /identity/v3/users/399159209bc64116be3deaf6faec0287 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:24.603945 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.604230 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.604502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.624652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:24.625843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.690862 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1437/2897] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:24.700987 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:24.702797 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:24.760291 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:24.765194 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237a54-4aa2-41d3-aef4-09b4478db8b7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:24.770825 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:24.772082 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:24.772332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:24.772625 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:24.782414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:24.784028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:24.793854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1461/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:25.132435 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:25.133556 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:25.146734 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c1dca-9ac0-4e94-83db-c8312e1b4acd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:25.151071 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:25.151805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:25.152156 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:25.152504 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] PATH_INFO: `/v3/projects/06df2469852a438a923f95e7974ba225` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:25.153716 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06df2469852a438a923f95e7974ba225)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:25.155758 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:25.210729 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06df2469852a438a923f95e7974ba225', 'request_id': 'req-efce17be-229c-4014-b3e6-1038ae01429e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.219671 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06df2469852a438a923f95e7974ba225', 'request_id': 'req-efce17be-229c-4014-b3e6-1038ae01429e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.226969 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06df2469852a438a923f95e7974ba225', 'request_id': 'req-efce17be-229c-4014-b3e6-1038ae01429e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.241526 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] The token cache is being invalidate because project 06df2469852a438a923f95e7974ba225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:25.242040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.242881 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.245857 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1438/2899] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:25 2022] DELETE /identity/v3/projects/06df2469852a438a923f95e7974ba225 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:25.251304 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:25.263333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91c87-4c48-48c7-822c-949939011514 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:25.334519 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:25.335235 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:25.335515 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:25.335786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] PATH_INFO: `/v3/users/eb9df709f87640f99e2959d7e6695908` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:25.336952 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9df709f87640f99e2959d7e6695908)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:25.338885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:25.398099 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9df709f87640f99e2959d7e6695908'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.412250 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9df709f87640f99e2959d7e6695908'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.413135 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9df709f87640f99e2959d7e6695908'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.413813 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9df709f87640f99e2959d7e6695908'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.428020 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce14e67b-ad26-4a1a-95f7-a750a4164664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9df709f87640f99e2959d7e6695908'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.441769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1462/2900] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:25 2022] DELETE /identity/v3/users/eb9df709f87640f99e2959d7e6695908 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:25.769085 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:25.771292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:25.797868 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce17be-229c-4014-b3e6-1038ae01429e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:25.813013 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:25.869791 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:25.870441 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:25.870723 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:25.871000 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] PATH_INFO: `/v3/projects/86d564f684534cd1b10fe2406059302a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:25.872500 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d564f684534cd1b10fe2406059302a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:25.874086 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:25.930061 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d564f684534cd1b10fe2406059302a', 'request_id': 'req-138be104-50e1-4d92-acf0-05e402717e24'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.939292 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d564f684534cd1b10fe2406059302a', 'request_id': 'req-138be104-50e1-4d92-acf0-05e402717e24'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.947748 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d564f684534cd1b10fe2406059302a', 'request_id': 'req-138be104-50e1-4d92-acf0-05e402717e24'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.961849 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] The token cache is being invalidate because project 86d564f684534cd1b10fe2406059302a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:25.962151 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.963587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-138be104-50e1-4d92-acf0-05e402717e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:25.965406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1439/2901] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:25 2022] DELETE /identity/v3/projects/86d564f684534cd1b10fe2406059302a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:25.971607 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:25.972234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:25.972746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:25.996478 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:25.998477 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:26.073631 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1463/2902] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:26.082016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.082572 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.082936 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.106865 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:26.109106 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:26.123074 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1440/2903] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:26.125571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.137500 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fa9f3-ad14-4356-8695-0fbcf3053e51 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.144001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.144816 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.145472 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.145888 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.146708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 14:26:26.147187 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.149692 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.158642 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:26.171215 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1464/2904] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 12 14:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 14:26:26.172370 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.201505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db39236-bedd-40a7-b6b4-abd6624efa84 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.208384 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.209200 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.209561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.209925 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.210632 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.213515 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.247818 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1441/2905] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:26.252587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.263970 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137717a-1bb7-4f33-b1b9-bb37a9fdc19c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.328079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.328455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.328735 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.329005 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.329639 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.332317 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.363189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1465/2906] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:26.367706 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.380035 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4dc1b-c808-4f43-9871-c40637b7d053 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.385651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.386800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.386800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.386800 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.387497 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.389089 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.401216 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1442/2907] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:26.404828 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.416426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead73b3-9d61-48ff-a9b8-250a8d20a4a3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.422299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.422916 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.423230 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.423510 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.424198 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.425807 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3234c8-0611-4be5-855d-382ad9465925 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.437081 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1466/2908] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:26.441389 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.451145 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344630-19ca-4c04-8751-01bd0bdc3a2d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.456353 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.457003 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.457286 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.457561 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] PATH_INFO: `/v3/projects/759f0d0fee7447d39b73f02726064fb8/users/6cfcdf2a0e9848e09f171146dc607672/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.473931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759f0d0fee7447d39b73f02726064fb8, user_id=6cfcdf2a0e9848e09f171146dc607672, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.476845 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.492189 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1443/2909] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:26 2022] PUT /identity/v3/projects/759f0d0fee7447d39b73f02726064fb8/users/6cfcdf2a0e9848e09f171146dc607672/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:26.503618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036320e5-a134-48b5-ab17-84c610574051 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.503898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036320e5-a134-48b5-ab17-84c610574051 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.504218 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036320e5-a134-48b5-ab17-84c610574051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.534192 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-036320e5-a134-48b5-ab17-84c610574051 None None] MFA Rules not processed for user `6cfcdf2a0e9848e09f171146dc607672`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:26.535583 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-036320e5-a134-48b5-ab17-84c610574051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:26.606622 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1467/2910] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:26.611600 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.659064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:26.677715 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8433-044d-466b-bb62-77b297cb4a64 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.682432 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.683070 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.683362 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.683695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.684350 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.686322 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.716491 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1444/2911] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:26.721831 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036320e5-a134-48b5-ab17-84c610574051 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.735224 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036320e5-a134-48b5-ab17-84c610574051 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.805467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.806189 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.806467 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.807067 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.807613 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.809806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.825001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:26.838977 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1468/2912] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 14:26:26.842785 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.853811 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55f3c-99dd-48e2-a34e-2078a4fb1552 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.860014 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.860633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.860912 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.861183 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.862033 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.864118 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.876394 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1445/2913] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 14:26:26.880926 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.894051 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e620c84-deeb-41b0-9674-a8dd9d692274 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.900368 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.900968 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.901241 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.901512 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.902157 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.903791 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8243e5-9cda-4fc1-b5ce-dd8bbb2af2c4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.917481 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1469/2914] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:26.918673 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:26.929612 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3539c-34c7-4eff-9bf1-bdab8e847628 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:26.935406 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:26.936158 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.936509 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.936885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] PATH_INFO: `/v3/projects/49f3694b60374b96964a1eba3621cbad/users/588c0e2bb72442e3a35da28ee6309411/roles/0e87e6c9d5914c0b801767f5bbc21ad6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:26.958186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f3694b60374b96964a1eba3621cbad, user_id=588c0e2bb72442e3a35da28ee6309411, role_id=0e87e6c9d5914c0b801767f5bbc21ad6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:26.960954 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:26.979090 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1446/2915] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:26 2022] PUT /identity/v3/projects/49f3694b60374b96964a1eba3621cbad/users/588c0e2bb72442e3a35da28ee6309411/roles/0e87e6c9d5914c0b801767f5bbc21ad6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:26.990446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:26.990841 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:26.991191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.026065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] MFA Rules not processed for user `588c0e2bb72442e3a35da28ee6309411`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:27.027431 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:27.119306 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1470/2916] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:27.123709 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.220196 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43068d63-7e55-4809-a7a8-224df01ee223 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.233648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.234417 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.234931 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.237241 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.238016 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.240100 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.279646 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1447/2917] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:27 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:27.283626 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.299723 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75179-8b17-46f9-83c7-f9ede2dd765b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.437358 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.438001 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.438292 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.438572 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.439254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.441257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.495549 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1471/2918] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:27 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:27.497181 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.512623 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fbc4-7fff-486d-9623-85207bcc2bea admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.519142 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.519674 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.519952 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.520224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.520874 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.522478 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.534282 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1448/2919] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:27.538864 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.551504 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673593c6-b52e-42c5-8506-a5b6b942ce87 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.558085 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.558852 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.559262 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.559602 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] PATH_INFO: `/v3/projects/bf6beacb227f4c5cb650d196d07d38bb/users/a7e181c556b6411f9a321660dcb8e164/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.577753 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6beacb227f4c5cb650d196d07d38bb, user_id=a7e181c556b6411f9a321660dcb8e164, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.581131 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.604997 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1472/2920] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:27 2022] PUT /identity/v3/projects/bf6beacb227f4c5cb650d196d07d38bb/users/a7e181c556b6411f9a321660dcb8e164/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:27.609099 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.624006 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b067-9a19-4ac1-8c56-08df3275067e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.710975 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.711633 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.712545 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.712826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.714022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.715744 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891547e-dcb9-4104-84ab-63b7ce43e282 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.731169 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1449/2921] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:27.732399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.743078 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7aba3-b773-4e1d-9d5f-39e06ed5b571 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.748769 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.749687 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.750038 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.750311 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] PATH_INFO: `/v3/projects/bf6beacb227f4c5cb650d196d07d38bb/users/a7e181c556b6411f9a321660dcb8e164/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.755996 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6beacb227f4c5cb650d196d07d38bb, user_id=a7e181c556b6411f9a321660dcb8e164, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:27.760924 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:27.772713 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1473/2922] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:27 2022] PUT /identity/v3/projects/bf6beacb227f4c5cb650d196d07d38bb/users/a7e181c556b6411f9a321660dcb8e164/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:27.782559 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c822-293d-46ad-8530-fbcf1af80abe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.782843 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c822-293d-46ad-8530-fbcf1af80abe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.783146 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c822-293d-46ad-8530-fbcf1af80abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:27.791971 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:27.815793 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4e41c822-293d-46ad-8530-fbcf1af80abe None None] MFA Rules not processed for user `a7e181c556b6411f9a321660dcb8e164`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:27.817278 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4e41c822-293d-46ad-8530-fbcf1af80abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:27.901852 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1450/2923] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:27.910210 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:27.912299 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:27.951836 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:27.985464 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ee2b-bd8e-4a50-b64d-c6804c6e2779 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:27.989719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:27.990332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:27.990611 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:27.990886 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:28.068026 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:28.069559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:28.081862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1474/2924] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:28.976243 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:28.976754 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:28.976856 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.010018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] MFA Rules not processed for user `5e0fe894b2ba46d0adc6050295a4126d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:29.011479 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:29.094484 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1451/2925] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:29.099261 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.100804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:29.182254 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f112-d807-4e00-ad21-c8a5e4329b46 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.186862 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.187571 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.187912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.188249 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.188961 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.191496 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.220993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1475/2926] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 12 14:26:29 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:29.225907 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.238372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43d06-e6a6-498c-b405-202ec94f2a43 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.307439 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.308053 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.308319 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.308587 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.309226 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.311298 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.337093 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1452/2927] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 12 14:26:29 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 14:26:29.341859 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.353111 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1394b-7e7e-4a8a-b0d4-a5dacd27498d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.358409 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.359108 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.359331 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.359600 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.360245 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.362498 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.374804 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1476/2928] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:29.379906 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.390302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f92b8d-7bee-43b3-a086-490da84bfd22 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.395097 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.395691 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.395972 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.396242 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] PATH_INFO: `/v3/projects/9a835fd33fb24a9e8b44126867d11284/users/1883eb445d1d453e98fc69429aa368e8/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.399552 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:29.413045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a835fd33fb24a9e8b44126867d11284, user_id=1883eb445d1d453e98fc69429aa368e8, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.416864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.432229 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1453/2929] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:29 2022] PUT /identity/v3/projects/9a835fd33fb24a9e8b44126867d11284/users/1883eb445d1d453e98fc69429aa368e8/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:29.436213 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.447156 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb11a-878e-4672-b3df-8edd323490d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.500139 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:29.508562 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.509168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.509446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.509717 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.510363 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.512065 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.522200 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1477/2930] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 12 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 14:26:29.526492 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.536763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863ff53-dd9f-4e92-b9cd-8531606e18be admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.541374 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.542022 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.542297 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.542567 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] PATH_INFO: `/v3/projects/9a835fd33fb24a9e8b44126867d11284/users/1883eb445d1d453e98fc69429aa368e8/roles/c0a540da48234e2db9dc1b474267f52f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:29.544507 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a835fd33fb24a9e8b44126867d11284, user_id=1883eb445d1d453e98fc69429aa368e8, role_id=c0a540da48234e2db9dc1b474267f52f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:29.547227 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:29.558173 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1454/2931] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 12 14:26:29 2022] PUT /identity/v3/projects/9a835fd33fb24a9e8b44126867d11284/users/1883eb445d1d453e98fc69429aa368e8/roles/c0a540da48234e2db9dc1b474267f52f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:29.820451 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:29.822168 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:29.904066 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ddee-438c-4840-9986-a332c489901a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:29.970390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:29.970390 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:29.970593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:29.970838 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:30.033506 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:30.034923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d531-e33f-435e-aaad-48732699643e service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:30.044326 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1478/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:30.728835 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:30.740447 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f445-ed12-4c70-8586-91cfb5ddbb71 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:30.744981 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37a474226dec48deb747b50c68c5b14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:30.745684 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:30.746037 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:30.746738 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:30.820186 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:30.821651 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:30.833051 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1455/2933] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:34.564938 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:34.565534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:34.565534 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:34.628708 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] MFA Rules not processed for user `1883eb445d1d453e98fc69429aa368e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:34.630444 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:34.693756 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:34.725093 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1479/2934] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:34.746323 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:34.747909 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:34.839174 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ac9d-1794-441d-a404-aaf605ec26fd service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:34.845728 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:34.846677 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:34.846961 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:34.847299 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:34.920347 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:34.922081 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b2940-4b52-4872-9fbc-d046add1531f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:34.933040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1456/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:35.436894 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:35.504654 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e753365-1837-486a-b7c0-0598a4bdef5a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:35.510132 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:35.510923 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:35.511048 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:35.511401 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] PATH_INFO: `/v3/users/6cfcdf2a0e9848e09f171146dc607672` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:35.512554 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfcdf2a0e9848e09f171146dc607672)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:35.514790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:35.567169 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfcdf2a0e9848e09f171146dc607672'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:35.575553 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfcdf2a0e9848e09f171146dc607672'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:35.576314 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfcdf2a0e9848e09f171146dc607672'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:35.576944 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfcdf2a0e9848e09f171146dc607672'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:35.589867 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfcdf2a0e9848e09f171146dc607672'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:35.603069 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1480/2936] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:35 2022] DELETE /identity/v3/users/6cfcdf2a0e9848e09f171146dc607672 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:35.607648 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d02f7-6a2c-4bbf-bb39-97ca1e55910e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:35.608291 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d02f7-6a2c-4bbf-bb39-97ca1e55910e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:35.608652 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d02f7-6a2c-4bbf-bb39-97ca1e55910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:35.616714 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:35.631616 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c38d02f7-6a2c-4bbf-bb39-97ca1e55910e None None] MFA Rules not processed for user `4690e95140304ab282894ee992a544f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:35.633031 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c38d02f7-6a2c-4bbf-bb39-97ca1e55910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:35.703499 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1457/2937] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 14:26:35.716257 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:35.718184 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:35.780457 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662673b-427e-4692-9ab1-cb706efcde69 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:35.784718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:35.785333 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:35.785618 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:35.785897 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:35.797032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:35.798624 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:35.814669 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1481/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:26:36.008695 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297419b-78da-442f-954d-906bb4e02168 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:36.009154 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297419b-78da-442f-954d-906bb4e02168 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:36.009264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297419b-78da-442f-954d-906bb4e02168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:36.036613 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d297419b-78da-442f-954d-906bb4e02168 None None] MFA Rules not processed for user `5e0fe894b2ba46d0adc6050295a4126d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 14:26:36.036963 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d297419b-78da-442f-954d-906bb4e02168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:36.098454 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1458/2939] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 12 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 14:26:36.200191 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:36.201703 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:36.220619 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a9b1-8b59-4870-afae-fd2b16fae177 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:36.234154 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:36.234811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:36.235266 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:36.235471 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] PATH_INFO: `/v3/projects/759f0d0fee7447d39b73f02726064fb8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:36.236651 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759f0d0fee7447d39b73f02726064fb8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:36.238786 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:36.245586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:36.308316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759f0d0fee7447d39b73f02726064fb8', 'request_id': 'req-f3b1fd14-1c83-49da-bcff-96eaea498144'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.314340 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759f0d0fee7447d39b73f02726064fb8', 'request_id': 'req-f3b1fd14-1c83-49da-bcff-96eaea498144'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.323812 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759f0d0fee7447d39b73f02726064fb8', 'request_id': 'req-f3b1fd14-1c83-49da-bcff-96eaea498144'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.338294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] The token cache is being invalidate because project 759f0d0fee7447d39b73f02726064fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:36.338294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.339112 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.340990 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1482/2940] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:36 2022] DELETE /identity/v3/projects/759f0d0fee7447d39b73f02726064fb8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:36.347576 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297419b-78da-442f-954d-906bb4e02168 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:36.363403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297419b-78da-442f-954d-906bb4e02168 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:36.428044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:36.428826 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:36.429110 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:36.429530 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] PATH_INFO: `/v3/users/588c0e2bb72442e3a35da28ee6309411` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:36.430688 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588c0e2bb72442e3a35da28ee6309411)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:36.432944 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:36.501627 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588c0e2bb72442e3a35da28ee6309411'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.505177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:36.511224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588c0e2bb72442e3a35da28ee6309411'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.512355 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588c0e2bb72442e3a35da28ee6309411'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.513789 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588c0e2bb72442e3a35da28ee6309411'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.529179 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588c0e2bb72442e3a35da28ee6309411'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:36.554516 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1459/2941] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:36 2022] DELETE /identity/v3/users/588c0e2bb72442e3a35da28ee6309411 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:36.852586 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:36.854668 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:36.872468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1fd14-1c83-49da-bcff-96eaea498144 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:36.938385 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:36.939456 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:36.940537 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:36.941011 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] PATH_INFO: `/v3/projects/49f3694b60374b96964a1eba3621cbad` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:36.942590 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f3694b60374b96964a1eba3621cbad)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:36.944570 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:37.010307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f3694b60374b96964a1eba3621cbad', 'request_id': 'req-0485b4f2-6ad7-40a3-8101-a417683ec070'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.018216 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f3694b60374b96964a1eba3621cbad', 'request_id': 'req-0485b4f2-6ad7-40a3-8101-a417683ec070'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.028854 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f3694b60374b96964a1eba3621cbad', 'request_id': 'req-0485b4f2-6ad7-40a3-8101-a417683ec070'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.040956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] The token cache is being invalidate because project 49f3694b60374b96964a1eba3621cbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:37.041397 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.042166 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.043929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1483/2942] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:36 2022] DELETE /identity/v3/projects/49f3694b60374b96964a1eba3621cbad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:37.047897 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:37.049941 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:37.066042 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674b37-83e7-457c-b120-7409754a9ca5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:37.139398 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:37.140224 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:37.140513 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:37.140787 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] PATH_INFO: `/v3/users/a7e181c556b6411f9a321660dcb8e164` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:37.141960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e181c556b6411f9a321660dcb8e164)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:37.144485 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:37.200337 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e181c556b6411f9a321660dcb8e164'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.211910 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e181c556b6411f9a321660dcb8e164'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.212687 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e181c556b6411f9a321660dcb8e164'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.213495 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e181c556b6411f9a321660dcb8e164'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.224816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e181c556b6411f9a321660dcb8e164'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.246204 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1460/2943] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:26:37 2022] DELETE /identity/v3/users/a7e181c556b6411f9a321660dcb8e164 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 14:26:37.536531 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:37.538047 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:37.555376 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485b4f2-6ad7-40a3-8101-a417683ec070 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:37.574511 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:37.622956 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:37.623636 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:37.624032 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:37.624236 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] PATH_INFO: `/v3/projects/bf6beacb227f4c5cb650d196d07d38bb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:37.625739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6beacb227f4c5cb650d196d07d38bb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:37.627806 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:37.696984 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6beacb227f4c5cb650d196d07d38bb', 'request_id': 'req-01cb888c-03fe-45ed-8383-cbca7d311ac4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.706726 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6beacb227f4c5cb650d196d07d38bb', 'request_id': 'req-01cb888c-03fe-45ed-8383-cbca7d311ac4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.717533 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6beacb227f4c5cb650d196d07d38bb', 'request_id': 'req-01cb888c-03fe-45ed-8383-cbca7d311ac4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.739885 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] The token cache is being invalidate because project bf6beacb227f4c5cb650d196d07d38bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:26:37.740209 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.740845 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:26:37.742473 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1484/2944] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:26:37 2022] DELETE /identity/v3/projects/bf6beacb227f4c5cb650d196d07d38bb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:26:47.242553 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:47.736953 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:58.956817 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:26:58.958263 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:59.029034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fefb9-a20a-4079-ba29-720fb1857dd8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:26:59.087192 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:26:59.087720 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:26:59.087996 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:26:59.088269 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:26:59.089989 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:26:59.101535 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:26:59.103140 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:26:59.113344 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1461/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:26:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:27:08.453000 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:27:08.454433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:27:08.511543 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb888c-03fe-45ed-8383-cbca7d311ac4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:27:08.515119 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:27:08.515719 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:27:08.515994 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:27:08.516270 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:27:08.517965 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:27:08.578919 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:27:08.580372 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:27:08.590129 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1485/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:27:09.108755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=58 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:27:10.363059 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:27:10.364657 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:27:10.436864 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f7da3-9ef3-4c0d-bd91-dfd6310bf9ca service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:27:10.443144 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:27:10.443766 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:27:10.444044 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:27:10.444316 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:27:10.446087 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:27:10.460307 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:27:10.462113 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:27:10.473895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1462/2947] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:27:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:27:18.585993 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=50 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:27:20.469742 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=34 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:29:33.192400 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:33.193789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:33.204593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd2526-e2ef-4778-8799-2c195f654a3a service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:33.208650 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:33.209234 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:33.209509 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:33.209780 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:33.211470 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:33.224912 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:33.226316 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:33.237228 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1486/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:34.428064 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:34.437573 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622c09-b569-40f6-a851-6c8a52d2e48f service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:34.441165 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:34.441755 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:34.442032 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:34.442305 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:34.444041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:34.457771 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:34.459232 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:34.470177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1463/2949] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:43.232199 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:29:43.322446 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:43.331125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1812-d4f9-476c-a2cf-cc3114723f2d service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:43.334794 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:43.335414 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:43.335694 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:43.335966 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:43.337666 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:43.346898 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:43.348860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:43.356746 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1487/2950] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:44.465317 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:29:46.544068 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:46.553375 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31add6-bd0b-4cc9-a2f1-b8873ac443a9 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:46.557170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:46.557763 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:46.558040 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:46.558310 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:46.560041 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:46.572805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:46.572805 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:46.580034 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1464/2951] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:46.658288 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:46.667110 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3006b-7d47-4486-9ed8-ac3ac2c9db1c service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:46.670684 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:46.671307 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:46.671588 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:46.671860 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:46.673688 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:46.687635 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:46.689052 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:46.705378 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1488/2952] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:46.769577 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:46.770974 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:46.785726 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a843-8948-4e76-b1ac-9e125670a1f3 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:46.790611 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:46.791223 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:46.791502 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:46.791770 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:46.793423 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:46.804985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:46.806548 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:46.816876 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1465/2953] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:49.041538 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:29:49.052959 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c741-5d9c-4270-87e1-41af65a2e4ec service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:29:49.058399 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:29:49.059165 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:29:49.059447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:29:49.059718 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:29:49.061447 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:29:49.074497 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:29:49.076137 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:29:49.087659 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1489/2954] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:29:56.812079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=12 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:29:59.082747 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=18 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:32:43.203707 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:32:43.262057 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd20206-78af-45ff-9a63-81f1f2fd1c59 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:32:43.267176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:32:43.267777 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:32:43.268072 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:32:43.268329 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:32:43.276803 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:32:43.278372 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:32:43.288045 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1466/2955] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:32:53.283895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=27 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:33:17.317887 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:17.389815 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515960-cdad-487b-a545-45e6efa5d133 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:17.395294 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:17.395896 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:17.396172 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:17.396445 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:17.398151 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:17.465101 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:17.466714 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:17.475433 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1490/2956] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:33:19.139985 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:19.154062 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982f86-c001-4b0b-983c-6b581f2a4f09 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:19.159902 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:19.160505 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:19.160779 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:19.161048 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:19.171757 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:19.173402 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:19.186993 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1467/2957] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:33:21.236293 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:21.249526 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7815ec-f8b6-420c-888f-8c28204a9563 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:21.255559 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91855d376b741ef957a6352eedee1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:21.256279 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:21.256792 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:21.257075 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:21.258955 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:21.286702 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:21.288455 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:21.300768 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1491/2958] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 14:33:23.050191 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:23.069345 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfac07-33f9-4074-8b88-3a2fc82eec46 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:23.072892 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad75668ae8ba47e7a3a2736e338c1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:23.073489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:23.073769 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:23.074043 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:23.075752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:23.160001 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:23.161457 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:23.180430 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1468/2959] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:33:26.200023 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:26.211775 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aecda-7186-4a3b-81fb-52ff80941ca7 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:26.217741 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:26.218763 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:26.219310 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:26.219811 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:26.223015 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:26.253725 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:26.255486 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:26.268422 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1492/2960] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:33:29.268644 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:29.281947 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318d605-c1f7-4b07-83ee-03d3306ce138 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:29.287579 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:29.288442 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:29.288713 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:29.288987 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:29.290781 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:29.308259 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:29.309801 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:29.322885 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1469/2961] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:33:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:33:29.336121 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:29.339426 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:29.354789 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d693-0cac-408d-aaf3-f6634fbb21ea service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:29.359790 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:29.360449 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:29.360721 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:29.360991 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] PATH_INFO: `/v3/users/5e0fe894b2ba46d0adc6050295a4126d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:29.362309 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0fe894b2ba46d0adc6050295a4126d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:29.365013 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:29.413125 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:33:29.415929 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0fe894b2ba46d0adc6050295a4126d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.423126 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0fe894b2ba46d0adc6050295a4126d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.424079 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0fe894b2ba46d0adc6050295a4126d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.424686 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0fe894b2ba46d0adc6050295a4126d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.436468 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0fe894b2ba46d0adc6050295a4126d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.449217 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1493/2962] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:33:29 2022] DELETE /identity/v3/users/5e0fe894b2ba46d0adc6050295a4126d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:33:29.618543 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:29.633816 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bcf0-d8a8-4cd0-8ada-a698f165534a service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:29.690792 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:29.691486 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:29.691895 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:29.692176 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] PATH_INFO: `/v3/projects/166b6ba5dcc642f3a8b033e3ba2293c5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:29.693302 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166b6ba5dcc642f3a8b033e3ba2293c5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:29.695264 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:29.729510 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:33:29.742489 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166b6ba5dcc642f3a8b033e3ba2293c5', 'request_id': 'req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.750170 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166b6ba5dcc642f3a8b033e3ba2293c5', 'request_id': 'req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.755836 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166b6ba5dcc642f3a8b033e3ba2293c5', 'request_id': 'req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.767177 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] The token cache is being invalidate because project 166b6ba5dcc642f3a8b033e3ba2293c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:33:29.767461 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.768067 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.769531 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1470/2963] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:33:29 2022] DELETE /identity/v3/projects/166b6ba5dcc642f3a8b033e3ba2293c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:33:29.773727 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:29.775162 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:29.787946 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df2f4-388c-467a-8bac-fab58e7126e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:29.842453 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:29.843003 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:29.843315 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:29.843587 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] PATH_INFO: `/v3/users/1883eb445d1d453e98fc69429aa368e8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:29.844689 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1883eb445d1d453e98fc69429aa368e8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:29.846593 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:29.893196 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1883eb445d1d453e98fc69429aa368e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.900123 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1883eb445d1d453e98fc69429aa368e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.900732 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1883eb445d1d453e98fc69429aa368e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.901332 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1883eb445d1d453e98fc69429aa368e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.912935 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1883eb445d1d453e98fc69429aa368e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:29.924672 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1494/2964] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 12 14:33:29 2022] DELETE /identity/v3/users/1883eb445d1d453e98fc69429aa368e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:33:30.094023 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:33:30.095438 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:33:30.110689 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29661b80-aa3c-446e-b2bd-92eb4b9a4b21 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:33:30.168776 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4690e95140304ab282894ee992a544f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f81b8c04c00483f8fd1db4c83254d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:33:30.169403 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:33:30.169680 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:33:30.169948 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] PATH_INFO: `/v3/projects/9a835fd33fb24a9e8b44126867d11284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:33:30.171054 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a835fd33fb24a9e8b44126867d11284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:33:30.172967 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:33:30.217519 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a835fd33fb24a9e8b44126867d11284', 'request_id': 'req-035a3ef7-3526-4d4e-be14-7382015858ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:30.223960 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a835fd33fb24a9e8b44126867d11284', 'request_id': 'req-035a3ef7-3526-4d4e-be14-7382015858ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:30.230005 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a835fd33fb24a9e8b44126867d11284', 'request_id': 'req-035a3ef7-3526-4d4e-be14-7382015858ce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:30.241079 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] The token cache is being invalidate because project 9a835fd33fb24a9e8b44126867d11284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 14:33:30.241373 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:30.242018 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-035a3ef7-3526-4d4e-be14-7382015858ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 14:33:30.243503 dv-cinder-820027-25-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1471/2965] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 12 14:33:30 2022] DELETE /identity/v3/projects/9a835fd33fb24a9e8b44126867d11284 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 14:33:39.921259 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:33:40.237752 dv-cinder-820027-25-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:37:51.247351 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 14:37:51.248739 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:37:51.316523 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7244f-1153-4590-9470-2a91a350527d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 14:37:51.375248 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa6ff05a95b47628fb5208f4b021948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11d3d20415e14e63bf4d66466eedf6cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 14:37:51.375778 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 14:37:51.376055 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 14:37:51.376325 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 14:37:51.378028 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 14:37:51.389029 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 14:37:51.390591 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b54f-9a18-4129-978c-9125b4988c18 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 14:37:51.400413 dv-cinder-820027-25-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1495/2966] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 12 14:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 14:38:01.396161 dv-cinder-820027-25-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=58 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}